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BAYES  DECISION  THEORY: 

INSENSITIVITY  TO  NON -OPTIMAL  DESIGN 
Gordon  R.  Antelman 

CHAPTER  I. 

INTRODUCTION 

1 . 1  Summary 

This  report  presents  for  several  fixed  sample  size  decision  problems 
upper  bounds  for  where  n^  is  the  Bayes  optimal 

fixed  sample  size,  r^(n)  is  th^  expected  terminal  opportunity  loss  for  a 
sample  of  size  n,  r'^(n)  is  the  expected  sampling  loss,  or  cost,  for  a  sample 
of  size  n,  and  r(n)  =  r^(n)  +  r^(n)  is  the  total  expected  opportunity  loss 
for  a  sample  of  size  n.  For  one  of  the  main  problems  considered  here, 

Raiffa  and  Schlaifer  [1]  give  a  nomographic  procedure  for  finding  n^;  for 
several  others  they  give  explicit  formulas  for  n^.  Equations  from  which 
n^  can  be  determined  explicitly  or  numerically  are  given  here  for  those  pro¬ 
blems  which  have  not  been  considered  elsewhere.  Generally  speaking,  the 
upper  bound  on  r(n)/r(n^)  shows  that  r(n)  is  insensitive  to  n.  The  upper 

bound  in  conjunction  with  expressions  for  n  can  be  used  to  show  that  r(n) 

o 

is  insensitive  to  the  use  of  the  wrong  prior  distribution  or  the  wrong  cost 
parameters . 

All  of  the  problems  considered  here  have  four  common  properties:  only 
fixed  sample  size  procedures  are  considered,  terminal  opportunity  losses 
are  a  function  of  only  one  process  parameter,  prior  distributions  are  con¬ 
tinuous,  and  terminal  opportunity  losses  and  sampling  losses  are  additive. 
All  of  the  finite-action  problems  considered  are  on  the  mean  of  a  Normal 
process.  The  estimation  problems  considered  involve  Bernoulli,  Poisson,  or 
Normal  processes  and,  except  in  one  case,  quadratic  terminal  opportunity 
losses.  For  the  non  asymptotic  results,  conjugate  prior  distributions  are 
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assumed.  —  Throughout  the  report,  "loss"  will  refer  to  "opportunity  loss.'.' 

This  Investigation  started  from  a  conjecture  of  Schlalfer's,  For  the 
two-action  problem  on  the  mean  of  a  Normal  process  of  known  variance  with  a 
Normal  prior  distribution  of  the  process  mean,  linear  terminal  utilities 
(which  result  In  linear  terminal  losses),  and  proportional  sampling  costs, 
Schlalfer  conjectured  that  r(n))/rin^'i)  <  ;(l/fe)(n/n^  *  n ^n)  if  >-0.  fhls 
Inequality  will  be  referred  to  as  "Schlalfer's  Inequality.."  In  an  unpub¬ 
lished  note,  I.  R.  Savage  proved  that  Schlalfer's  Inequality  holds  for  the 
problem  of  estimating  the  mean  of  a  Normal  process  of  known  variance  with  a 
Normal  prior  distribution  of  the  process  mean,  quadratic  terminal  losses, 
and  proportional  sampling  costs.  In  Section  2.k  (Theorem  2.4.1)  It  Is 
shown  to  hold  for  the  two-action  problem  for  which  It  was  conjectured. 

Another  Inequality,  related  to  Schlalfer's  Inequality  and  true  for  all  of 
the  problems  considered  for  which  Schlalfer's  Inequality  Is  true,  Is  that 
r^(n^)  >  r^(n^).  This  will  be  referred  to  as  the  "optimal  loss  partition 
Inequality 

Heurlstlcally ,  the  optimal  loss  partition  Inequality  and  Schlalfer's 
Inequality  are  true  for  the  tvo-actlon  problem  which  gave  rise  to  Schlalfer's 
Inequality,  as  well  as  many  other  fixed  sample  size  decision  problems,  be¬ 
cause  r^(n)  approaches.  In  the  "right  way,"  a  function  a/n  (a  >  O)  as  n 
Increases.  Thus,  for  r^(n)  =  bn(b>0), r(n)  =  a/n  +  bn.  It  Is  easily  shown 


a/  For  the  definition  of  "conjugate,"  see  [1,  p.47].  The  conjugates  of 
the  Bernoulli,  Poisson,  and  Normal  (known  variance)  processes  are  beta, 
gamma,  and  Normal  distributions  respectively. 

b/  In  [2,  p.^46],  Schlalfer  states  that  it  can  be  shown  that  th«  Inequality 
holds .  From  personal  communication  with  Schlalfer  it  was  learned  that 
the  Inequality  was  based  on  numerical  evidence  and  had  not  been  proved 
analytically. 
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that  If  f(n)  =  a/n  +  bn  Is  minimized  by  n  ,  then  a/n  =  bn  and  f(n)/f(n  )  = 

o  o  o  o 

(l/2)(n/n^  +  n^n).  The  first  equality  corresponds  to  the  optimal  loss  parti¬ 
tion  inequality;  the  second  equality  corresponds  to  Schlaifer's  inequality. 
Furthermore,  the  analysis  of  f(n)  above  generalizes  to:  if  g(n)  =  a/n  + 
bn^  (a,b,a,p  >  O)  is  minimized  by  n^,  then  a/n®  =  (p/a)bn^  and  g(n)/g(n  )  = 

3 


a 


a  +  p 


n 


P 


a  +  p 


a 


For  many  decision  problems  for  which  r^(n) 


approaches  a  function  a/n  as  n  increases,  and  r^(n)  =  bn^,  it  will  be^shown 

that  r^(nj>  (p/a)  r^(n^)  and  r(n)/r(n^)  <  ^  j^j  ^  if  >  0. 

These  inequalities  will  be  referred  to  as  the  "generalized  optimal  loss  parti¬ 
tion  inequality"  and  the  "generalized  Schlaifer's  inequality." 

In  Section  2.3,  certain  general  properties  of  r^(n)  are  assumed  and  a 
condition  (Condition  1,  Section  2.3)  on  r^(n)  is  given  and  shown  to  be  suf¬ 
ficient  for  the  generalized  optimal  loss  partition  inequality  (Theorem 
2.3-1)  •  A  second  condition  (Condition  II,  Section  2.3)  on  r^(n)  is  given 
and  it  is  shown  that  Conditions  I  and  II  are  sufficient  for  the  generalized 
Schlaifer's  inequality  (Theorem  2.3-2) .  The  Inequalities  are  shown  to  hold 
for  particular  problems  by  verifying  that  Conditions  I  and  II  hold  for  the 
particular  problems.  This  is  done  in  Section  2.4  for  several  two-action 
problems  on  the  mean  of  a  Normal  process  with  differing  terminal  and  samp¬ 
ling  loss  functions  and  differing  assumptions  about  the  process  variance. 

It  is  done  in  Section  2.^  for  several  quadratic  terminal  loss  estimation 
problems  and  one  linear  terminal  loss  estimation  problem. 

The  two-action  problem  on  the  mean  of  a  Normal  process  of  known  vari¬ 
ance  with  linear  terminal  losses  is  reconsidered  in  Section  3.2  with 
Normality  of  the  prior  distribution  relaxed  to  continuity.  This  problem 
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has  not  been  considered  elsewhere.  The  asymptotic  (cost  parameters  varying 
so  that  n^  tends  to  «)  optimal  sample  size  is  derived  and  it  is  noted  that 
the  generalized  optimal  loss  partition  inequality  and  the  generalized 
Schlaifer's  inequality  are  asymptotic  equalities.  The  asymptotic  form  of 
r^(n)  is  also  considered  for  constant  terminal  losses,  i.e.,  the  hypothesis 
testing  formulation,  and  quadratic  terminal  losses.  In  Sections  3-3 
3.4,  the  asymptotic  results  of  Section  3*2  for  two-action  problems  on  the 
mean  of  a  Normal  process  are  extended  to  several -act ion  problems. 

1 .2  Discussion 

The  insensitivity  of  total  expected  losses  to  a  non-optimal  design  is 
most  easily  illustrated  for  the  two-action  problem  on  the  mean  of  a  Normal 
process  of  known  variance  with  linear  terminal  losses,  proportional  samp¬ 
ling  costs,  and  a  continuous  prior  distribution  of  the  process  mean.  In 

I  T  /L 

Section  3*2  it  is  shown  that  n  =  (k  D  (ji.  )/2hk  +  0(k  /k  )  ,  where  k 

OCODS  CS  L 

and  k^  are  cost  parameters,  h"^  is  the  process  variance,  and  ^s  the 

density  (assumed  positive)  of  the  prior  distribution  at  the  breakeven  value 
of  the  process  mean  |i.  Also,  Schlaifer's  inequality  is  an  asymptotic 
equality.  If  D^(|ij^)  or  wrong  by  a  factor  of  k,  the  indicated  n^ 

will  differ  asymptotically  from  the  true  n^  by  a  factor  of  2,  and  r(n)  for 
the  indicated  n^  will  differ  asymptotically  from  the  true  r(n^)  by  a  factor 
of  (l/S)(2+l/2)-l  »  1/4;  if  Pq(p^,)  or  wrong  by  a  factor  of  2>  the 

asymptotic  difference  in  total  expected  losses  is  approximately  6%. 

For  the  two-action  problem  stated  above,  it  is  sometimes  convenient  in 
terminal  analysis,  i.e.,  deciding  which  action  is  best  after  observing  a 
sample  of  fixed  size,  to  assume  a  diffuse,  or  "informationless,"  prior  dis¬ 
tribution.  For  purposes  of  determining  the  optimal  sample  size,  the 
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assumption  of  a  diffuse  prior  distribution  is  definitely  not  "information¬ 
less."  Baiffa  and  Schlaifer  [1,  p.l2l]  note  that  for  the  two-action  problem 
above,  with  a  Normal  prior  distribution,  a  prior  variance  which  is  large 
relative  to  the  process  variance" .. .represents  a  great  deal  of  relevant  in¬ 
formation,  since  it  amounts  to  an  assertion  that  |a  is  almost  certainly  so 

far  from  the  breakeven  value  n,  in  one  direction  or  the  other  that  a  very 

b 

small  sample  can  show  with  near  certainty  on  which  side  of  (i,  the  true  n 

b 

actually  lies."  In  fact,  from  of  [1,  p.l2l],  it  is  easily  seen  that 

for  a  sequence  of  Normal  prior  distributions  with  a  common  mean  and  variances 
approaching  »,  n^  approaches  0  for  any  fixed  cost  parameters  and  process 
variance.  Thus,  it  is  not  surprising  that  n^  is  asymptotically  proportional 
to 

lo  [3]>  Guthrie  and  Johns  derive  asymptotic  formulas  for  optlinal  (Bayes) 
fixed  sample  sizes  for  two-action  problems  of  accepting  or  rejecting  a 
finite  lot  of  size  N.  They  assume  the  items  in  the  lot  can  be  characterized 
by  independent  and  identically  distributed  non  negative  (and  hence,  non  Nor¬ 
mal)  random  variables  with  a  certain  type  of  exponential  distribution  - 
including  the blnomlsil, Poisson,  negative  binomial,  and  gamma  distributions 
-  with  mean  Two  classes  of  prior  distributions  of  ^  are  considered:  es¬ 
sentially,  priors  continuous  in  a  neighborhood  of  u,  ,  the  breakeven  value  of 

D 

H,  and  priors  which  are  "discrete  around  hjj*"  For  fixed  sample  size  n, 

4  • 

terminal  lossaes  are  linear  in  ^  and  sampling  costs  are  proportional  to  n. 
Guthrie  and  Johns  find  that  n^,  the  optimal  sample  size,  is  asymptotically 

I 

proportional  to  N^  for  continuous  priors  and  asymptotically  proportional  to 
In  N  for  discrete  priors.  The  asymptotic  optimal  sample  size  for  two-action 
problems  on  the  mean  of  a  Normal  process  of  known  precision  derived  in 
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Chapter  3  c&n  be  shown  to  be  analogous  to  the  results  of  Guthrie  and  Johns 
for  continuous  priors. 

It  can  also  be  shown  from  the  results  of  Guthrie  and  Johns  that  for  the 
problems  which  they  consider,  as  n^  approaches  »,  (‘'g)  approaches 

1  for  continuous  prior  distributions  and  0  for  discrete  prior  distributions, 
Schleifer  [!<■]  has  shown,  for  the  two-action  problem  on  the  mean  of  a  Normal 
process  of  known  variance  with  proportional  sampling  costs  and  a  two- 
point  prior  distribution  of  the  process  mean,  that  ^*^s ^"o^  approaches 

0  as  n^  approaches  oo.  It  is  clear  that  for  fixed  sanple  size  two-action 
problems  with  linear  terminal  losses  and  proportional  sampling  costs,  the 
asymptotic  behavior  of  r^(n^) /r^ (n^)  depends  critically  on  the  form  of  the 
prior  distribution  near  the  breakeven  point.  The  reason  for  this  difference 
is  discussed  in  Section  2.4.3.  Is  also  noted  there  that  for  the  two- 
action  problems  being  discussed,  an  "indifference  region"  about  the  break¬ 
even  point  has  the  same  as)niiptotic  effect  on  r^(n^)/r^(n^)  as  a  discrete 
prior  distribution.  Chernoff  has  noted  in  [3]  that  for  the  optimal  (Bayes) 
strategy  for  sequentially  testing  the  simple  hypothesis  @  =  against 
the  simple  alternative  9=9^,  on  the  basis  of  observations  on  inde¬ 
pendent  and  identically  distributed  random  variables  with  density  f^(x) 
under  H^,  1  =  0,1,  approaches  0  as  n^  approaches  «,  where 

n^  now  denotes  the  optimal  expected  sample  size  and  sampling  costs  are 
assumed  proportional  to  the  sample  size.  This  result  holds  as  the  per  unit 
sampling  cost  approaches  0,  for  any  non  unitary  (two-point)  prior  distri¬ 
bution  and  positive  terminal  losses.  The  problem  of  finding  the  optimal 
(Bayes)  seq.ueotlal  procedure  for  the  two^actlop  priDblem  oii>the-ineaa'of  ttoBor- 
mal  process  of  known  variance  with  linear  terminal  losses,  proportional 
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sampling  costs,  and  a  continuous  prior  distribution  is  now  being  studied  by 
Chernoff  [6,7].  It  is  not  yet  known  how  behaves  for  this  pro¬ 

blem. 

Some  numerical  work,  not  included  in  this  report,  indicated  that  for 
both  the  optimal  fixed  saiqple  size  procedure  and  the  optimal  sequential  pro¬ 
cedure  for  the  two-action  problem  on  the  mean  of  a  Normal  process  of  known 
variance  with  equal  terminal  losses  for  wrong  actions,  proportional  samp¬ 
ling  coats,  and  a  two-point  prior  distribution,  the  ratio  of  the  loss  for  a 
wrong  action  to  the  per  unit  sampling  cost  must  be  extremely  large  to  make 

r^(n  )/r  (n  )  as  close  to  0  as,  say,  .10. 
t'  o  s'  o  ^ 
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CHAPTER  II. 


mCT^INEQ^^T^ 

2 . 1  Introduction 

In  [2],  Schlaifer  presents  the  solution  to  the  following  two-action 
decision  problem. 

Assume  that  the  prior  distribution  of  the  mean  |i  of  a  Normal  process 
of  known  variance  is  Normal  and  that  the  terminal  utilities  of  the  two 
actions  are  linear  functions  of  p.  If  the  cost  of  a  fixed  size  sample  is 
proportional  to  the  sample  size,  what  is  the  optimal  (Bayes)  fixed  sample 
size?  — ^ 

Schlaifer  conjectured  — ^Ibr  this  problem  that,  if  n^  >  0 

r(n)/r(n^)  S  (1/2)  (n/n^+n^/n)  (2-l) 

where 

n  =  arbitrary  fixed  sample  size 
n^  =  optimal  fixed  sample  size 

r(n)  s  expected  total  opportunity  loss  (expected  op¬ 
portunity  loss  from  wrong  decisions  plus  cost  (2-2) 

of  saiq>ling)  for  a  sample  of  size  n. 

The  inequality  (2-1)  will  be  referred  to  as  "Schlaifer's  inequality." 

Several  remarks  concerning  general  assumptions  and  terminology  in  the 
problem  above  and  those  to  follow  are  necessary.  First,  "loss"  will  al¬ 
ways  refer  to  opportunity  loss,  or,  regret.  Hence,  since  the  cost  of  a 


c/  The  solution,  to  a  problem  equivalent  to  this  problem,  was  first  given 
by  Grundy,  Healy,  and  Rees  [8].  The  most  complete  exposition  of  the 
problem  is  given  in  [1]. 

d/  footnote  b,  page  2. 
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sample  of  size  0  is  0,  sampling  cost  equals  sanq)llng  loss.  Second,  it  is 
assumed  throughout  the  report  that 

r(n)  =  r^(n)  +  r^(n)  (2-3) 

where  r(n)  is  defined  in  (2-2)  and 

r  (n)  =  expected  terminal  loss  (loss  from  wrong  decisions) 

"  (2-U) 


for  a  fixed  sample  of  size  n 
r  (n)  =  expected  san^ling  loss  for  a  fixed  sample  of 

®  (2.5) 


size  n. 

Third,  throughout  the  report,  only  fixed  sample  size  procedures  are  con¬ 
sidered.  Fourth,  "expected"  in  the  definitions  of  r(n),  r  (n),  and  r  (n) 

t  s 

refers  to  an  expected  loss,  prior  to  observing  a  sample  of  size  n,  as¬ 
sociated  with  the  optimal  terminal  action  posterior  to  observing  the  sample. 
Finally,  it  is  shown  in  [1]  that  if  terminal  and  sampling  utilities  (and 
hence  losses)  are  additive,  minimizing  expected  total  loss  is  equivalent 
to  maximizing  expected  total  utility;  all  of  the  analysis  here  is  in  terms 
of  losses . 

In  an  unpublished  note,  I.  R.  Savage  proved  that  Sc^laifer's  in¬ 
equality  is  true  for  the  problem  of  estimating  the  mean  of  a  Normal  process 
of  known  variance,  given  a  Normal  prior  distribution  of  the  process  mean, 
quadratic  terminal  losses,  and  sampling  costs  proportional  to  sample  size. 
Subsequently,  the  author  proved  that  Schlalfer's  inequality  is  true  for 
the  problem  for  which  it  was  conjectured  (Theorem  2.4.1)  as  well  as  several 
other  two-action  and  estimation  problems  with  sampling  costs  proportional 
to  sample  size.  Another  inequality,  used  here  in  the  proof  of  Schlalfer's 
inequality,  is  that  ^^.(n^)  >  r^(n^),  l.e.,  for  the  optimal  sample  size  the 
expected  terminal  loss  exceeds  the  expected  cost  of  sampling  (Theorem  2.4.1). 
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This  will  be  referred  to  m  the  "optimaj.  lass  partition  inequality.” 

Heurlstlcally ,  the  optimal  lose  partition  inequality  and  Schlaifer's 

inequality  are  true  for  many  decision  problems  with  r  (n)  =  bn  (b  >  O)  be- 

cause  r^(n)  approaches,  in  the  "right  way,"  a  hyperbola  a/n  (a  >  O)  «§  a 

increases.  It  is  easily  shown  that  if  f(n)  =  a/n  +  bn,  where  a  and  b  are 

positive  constants  and  n  is  a  positive  variable,  is  minimized  by  n^,  then 

a/n  =  bn  and  f(n)/f(n  )  =  (1/2)  (n/n  +  n  /n) .  The  first  equality  cor- 
0  0  o  o  o 

responds  to  the  optimal  loss  partition  inequality  and  the  second  to 

Schlaifer's  inequality.  Furthermore,  the  analysis  of  f(n)  above  generalizes 

to:  if  g(n)  =  a/n*^  +  bn^ ,  where  a  and  P  are  positive  constants,  is  mini- 

mized  by  n  ,  then  a/n^  =  (6 /a)  bn^  and 
•'  o  o  o 

8(n)  _  a  I "  I  *  P 

gliT)  "  a  +  p|n^|  a  +  p 

cx 

This  suggests,  for  problems  in  which  r^(n)  approaches  a  function  a/n  as  n 
increases  and  ^^(n)  =  bn^ ,  a  "generalized  optimal  loss  partition  inequality" 

rt(no)  >  (P/O')  ^s(”o) 
and  a  "generalized  Schlaifer's  inequality" 

r(n)  s  g  ^  +  P 

rtnp"  a  +  p  In^  g  +  P 

For  all  of  the  problems  considered  in  this  Chapter,  a  prior  distribution 
conjugate  to  the  process  is  assumed.  For  all  but  one  of  these  problems, 
the  generalized  optimal  loss  partition  inequality  and,  if  n^  >  0,  the 
generalized  Schlaifer's  Inequality,  with  values  of  g  and  p  dependent  on  the 
problem,  are  shown  to  hold  (with  several  minor  exceptions)  for  all  values 
of  the  prior,  process,  and  cost  parameters. 
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The  one  problem  for  which  Che  generalized  inequalities  are  not  necessarily 
true  provides  additional  insight  into  Che  general  behavior  of  n^  and  r(n). 

A  summary  of  the  exact  solution  to  the  two-action  problem  for  which 
Schlaifer's  inequality  was  conjectured  is  given  in  Section  2.2.  In  Section 
2.3,  two  general  conditions  on  r^(n)  are  given.  The  first  is  shown  to  be 
sufficient  for  the  generalized  optimal  loss  partition  inequality  and  the 
two  together  are  shown  to  be  sufficient  for  the  generalized  Schlaifer's 
inequality.  These  two  conditions  are  verified  for  several  two-action  pro¬ 
blems  on  the  mean  of  a  Normal  process  of  known  or  unknown  variance  in 
Sections  2.4.1  -  2.4.4.  In  Section  2.4.5>  it  is  shown  that  neither  of  the 
generalized  inequalities  is  necessarily  true  for  the  two-action  problem  on 
the  mean  ^  of  a  Normal  process  if  terminal  losses  are  0  throughout  an  "in¬ 
difference  region"  about  the  breakeven  value  of  The  two  conditions  on 
r^(n)  are  verified  for  several  estimation  problems  Involving  Bernoulli, 
Poisson,  and  Normal  processes  in  Section  2.^. 

2 .2  The  Optimal  Sample  Size  for  the  Two-Action  Problem  on  the  Mean  of  a 
Normal  Process  of  Known  Variance  with  Linear  Terminal  Losses,  Pro¬ 
portional  Sampling  Costs,  and.  Normal  Prior  Distribution  of  the 
Process  Mean. 

This  section  summarizes  the  complete  exposition  of  this  problem  pre¬ 
sented  in  [1].  The  notation  closely  follows  that^  of  [1];  in  particular, 
tildes  denote  random  variables . 

Let 

4  =  mean  of  a  Normal  process  generating  independent  random 

variables  x^,  ...  ,  each  Normally  distributed  (2-8) 

with  mean  ^  and  variance  1/h 
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where 


=  (h/?rr)^  e  -(‘'/2)(x-n)2 

X 

=/^  f^(t|j,,h}dt  .  Gjj(x|n.h)  =  1  .  Fjj(x|>i,h) 


(2-9) 

(2-10) 

(2-11) 


V*)  =  Fj,(x|0.l)  .  Gj,.Jx)  =  Gj,(x|0,l) 

prior  density  of  JT  =  jm' ,hn' ) 


A  =  action  space  =  (a2^»A2) 


uja^,  =  terminal  utility  of  action  a^  if  obtains 


=  +  k^ji,  i  =  1,2 


Mj,  =  breakeven  value  of  n  =  (k^  .  K^)/(k^  .  k^) 

=  terminal  loss  constant  =  jk^  -  | 

r^(n)  =  expected  sampling  cost  for  a  sanple  of  size  n 


=  k^n,  k^  >  0 

r^(n)  =  expected  terminal  loss  for  a  sanq>le  of  size  n 
r(n)  =  expected  total  loss  for  a  sample  of  size  n 


=  r^(n)  +  rg(n) 

If  m',  the  mean  of  the  prior  distribution  of  fl  is  s  u 
00 

rt(0)  fj^(n|m',  hn')dn 

=  k^(hn')-il^^  (D') 


(2-12) 

(2-13) 

(2-14) 

(2-15) 

(2-16) 

(2-17) 

(2-18) 

(2-19) 

(2-20) 


(2-21) 


D'  =  (hn')^  .  m'l 

V  (D-)  =^"  (x  -  D')  f^*(x)dx  = 


D-  Gj,,(D'). 


(2-22) 


(2-23) 
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If  m'  >  n. 

piv 

^^(0)  =1  -  ^l)  fjj(n|m',hn' )d|i 

^  *00 

but  this  again  reduces  to 

r^(0)  =  kj.(hn')^  I^^(D').  (2-21) 

Since  r(0)  =  r^(0),  (2-21)  gives  the  expected  total  loss  of  the  optimal  de¬ 
cision  without  sampling  (the  optimal  decision  is  to  take  the  action  for 
which  u^  (a^,m')  is  greater). 

If  a  sample  of  size  n  is  taken,  the  posterior  distribution  of  (I  is 

fjj(n|m".  hn“)  (2-2i^) 

where 

n 

n"  =  n'  +  n,  m"  =  (n'm*  +  nm)/n",  m  =  (1/0)5^  x  .  (2-25) 

i  =  1 

In  this  case,  the  optimal  deciaidn  is  to  take  the  action  for  which 

u.  (a.  ^m*)  is  greater  and  the  expected  terminal  loss  posterior  to  the  sample 
is  given  by  (2-21)  with  double  primes  replacing  the  single  primes.  Since 
the  optimal  decision  posterior  to  a  sample  of  size  n  depends  only  on  the 
mean  of  the  posterior  distribution  of  [I,  the  prior  expected  terminal  loss 
of  an  optimal  decision  following  a  sample  of  size  n  can  be  calculated  from 
the  prior  distribution  of  the  posterior  mean,  i.e.,  the  distribution  of  m" 

B  (n'm'  iA)/n".  For  m'S  or  m'  >  this  prior  expected  terminal  loss 

is  given  by 

r^(n)  =  r^(0)  -  (hn*)"^  (D*)  (2-26) 

where 

n*  =  n'n"/n,  D*  =  (hn*)^  -  m' |  .  (2-27) 

Thus,  the  expected  total  loss,  prior  to  observing  m,  of  an  optimal  decision 
following  a  sample  of  size  n  is,  from  (2-18),  (2-21),  and  (2-26) 
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r(n)  =  r^(n)  +  rg(n) 

=  kjhn')''^  ‘"s"' 

The  optimal  sanq>le  size,  n^,  is  Che  value  of  n  (assumed  to  be  a  continuous 
non-negative  variable)  which  minimizes  r(n),  given  by  (2-28)  for  n  >  0  and 
by  (2-21)  for  n  =  0.  Charts  are  provided  in  [1]  and  [2]  for  determining  n^ 
for  given  h,  n',  D',  k^,  and  k^ . 

2.3  Sufficient  Conditions  for  the  Generalized  Optimal  Loss  Partition 
Inequality  and  the  Generalized  Schlaifer's  Inequality 
Two  ad  hoc  conditions  on  r^(n)  are  presented  below.  Assuming  certain 
regularity  properties  of  r^(n).  Theorem  2.3.1  shows  that  the  first  condition 
is  sufficient  for  the  generalized  optimal  loss  partition  inequality  and 
Theorem  2.3.2  shows  that  Che  two  conditions  together  are  sufficient  for  Che 
generalized  Schlaifer's  inequality.  Theorem  2.3.3  will  prove  convenient  in 
applications  for  verifying  the  first  condition.  These  results  will  be  uti¬ 
lized  in  proving  the  optimal  loss  partition  inequality  and  Schlaifer's 
inequality  for  the  problem  of  Section  2.2  and  Che  generalized  Inequalities 
for  Che  other  problems  which  will  be  considered. 

The  regularity  properties  of  r^(n)  assumed  throughout  this  Section  are 
(^)  *  strictly  decreasing-function  of  n,  n  >  0.  (2-29) 

(ii)  d^r  (n)/dn^  exists  and  there  exists  an  n,  0 

^  (2-30) 

such  that  d^r^(n)/dn^  ^  0  for  n  ^  n^^,  n  >  0. 

a 

These  two  properties,  along  with  r^(n)  =  »  guarantee  that  either  = 

0  or  n^  is  unique  and  positive.  In  the  latter  case,  n^  >  n^.  No  attempt 
will  be  made  here  to  formally  characterize  decision  problems  for  which 
r^(n)  has  properties  (i)  and  (ii).  Informally,  the  generality  of  (i)  is 
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obrlous.  Its  assuBQitlon  rules  out,  for  exssiple,  problems  for  vhicb  r  (n)  is 
Infinite  for  some  or  all  n,  problems  for  which  the  prior  probability  is  one 
that  a  certain  action  is  preferred,  in  which  case  r^(n)  is  Identically  zero, 
and  problems  with  definitive  observations,  in  which  case  r^(n)  is  identically 
zero  for  all  n  >  1.  Property  (ii)  is  stronger.  It  implies  that  r^(n)  is  con¬ 
cave  for  n  between  zero  and  n^  and  convex  for  n  >  n^,  where  n^^  might  be  zero. 
An  intuitive  reason  for  this  behavior  of  r^(n)  for  the  problem  of  Section  2.2 
is  given  in  [l]  and  in  [2].  (Note:  for  purposes  of  analysis,  n  is  considered 
to  be  a  continuous  variable.) 

For  all  of  the  problems  considered  in  this  Chapter,  Including  the  one 
for  which  the  generalized  inequalities  are  not  necessarily  true,  properties 
(i)  and  (li)  of  r^(n)  are  easily  verified.  They  also  hold  for  many  two-action 
problems  involving  discrete  prior  distributions  for  which  the  generalized 
Inequalities  are  not  necessarily  true. 

The  first  ad  hoc  condition  on  r^(n)  is 

Condition  I:  dn°’r^(n)/dn  >  0,  some  a  >  0,  n  >  0.  (2-31) 

Theorem  2.3.1.  If  r  (n)  k  n^.  Condition  I  is  sufficient  for  the 

■  ■■—  -  —  '■* -  s  '  s' 

generalized  optimal  loss  partition  inequality  r  (n  )  >  (p/a)  r  (n  ).  (Note 

w  O  8  0 

that  if  Condition  I  holds  for  a  particular  a^,  it  holds  for  edl  a  >  a^.  The 
inequality  is  sharpest  for  the  smallest  a  for  which  Condition  I  holds.) 

Proof;  If  n^  =  0,  the  theorem  is  trlvlid;  hence,  assume  n^  >  0.  From 
Condition  I 

“o‘^t^“o^/^  +  >  0*  (2-32) 

Since  n^  is  a  stationary  point  of  r(n)  ■  ^^(q)  +  ^g(^) 

dr^(no)/dn  -  -  -  -pn^^  r^(n^).  (2-33) 
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Substituting  (2-33)  in  (2-32)  yields  -gr  (n  )  +  ar. (n  )  >  0,  or 

so  to 

r^(n^)  >  (^/o)  rg(n^). 

Corollary  1.  If  r.(n)  Is  convex,  nondecreasing,  and  approaches  0  as  n 

tends  to  0,  Condition  I  Is  sufficient  for  the  Inequality  ar^(n^)  >  r^(n^). 

Proof ;  If  =  0,  the  conclusion  Is  again  trivial;  hence,  assume 

n  >0.  Let  n^  be  the  unique  root  of  ar^(n)  =  r  (n)  and  define  r  (n)  = 
o  2  t  s  s 

(n"^  r  (n  ))n.  Then  f  (n^)  =  r  (n^)  and  from  the  assumptions  on  r  (n) 

S<dS^  s 

rg(n)  S  (g)  ^^(ng)  for  n  s  (^ )  n^.  (2-3I+) 

Letting  n^  denote  the  value  of  n  which  minimizes  r^(n)  +  f^(n),  the  theorem 
gives  ar^(n^)  >  r^(n^),  or  equivalently,  <  n^.  Now,  for  n  S  n^, 
r(n)  i  r  (n)  +  r  (n)  (from  (2-3^)) 

L  S 

>  r^(n^)  +  rg(n^)  (since  n^  <  n^)  (2-35) 

S  r  (n  )  +  r  (n  )  (from  (2-3^*). 
t  o  s  o 

Therefore,  n^  <  n^,  which  Implies  the  conclusion. 

Corollary  2.  If  r^(n)  =  0  for  n  •*  0  and  for  n  >  0,  Condition 

I  Is  sufficient  for  the  Inequality  a  r,.(n  )  >  3  k  n^ ,  If  r  (n)  =  0  for 

CO  8  0  8 

n  =  0  and  f  v^(n)  for  n  >  0,  where  v^fn)  Is  convex,  nondecreasing,  and 
approaches  0  as  n  tends  to  0,  Condition  I  Is  sufficient  for  the  Inequality 

ar  (n  )  >  V  (n  ). 

to  so 

The  second  hoc  condition  on  r^(n)  Is 
d  /n^^^dr  (n)| 

Condition  II:  ^  1  - I  <  0  ,  some  O  >  0,  n  >  0.  (2-36) 

Theorem  2.3.2.  If  r_(n)  =  k_n^.  Conditions  I  and  II  together  are  suf- 

flclent  for  the  generalized  Schlalfer's  Inequality  r(n'/r(n  )  S  (a/(a  +  3)) 

o 

(n/n^)^  +  (3/(a  +  3/)  ("g/'^)  f  where  n^  >  0  and  a  is  the  smallest  value  of  a 
for  tdiich  both  conditions  soa  true. 

Before  proving  this  theorem,  the  role  of  o  in  the  inequality  will  be 
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discussed.  In  Section  2.1,  the  generalized  Inequalities  were  suggested  for 
problems  for  which  r^(n)  =  and  r^(n)  approaches  a/n  as  n  tends  to  oo. 

It  Is  not  assumed  In  either  Theorem  2.3.1  or  Theorem  2.3.2  that  r^(n)  ap¬ 
proaches  a/n*^,  but  only  that  Conditions  I  and  II  hold  for  some  a.  As  noted 
after  Theorem  2 . 3 . 1 ,  the  generalized  optimal  loss  partition  Inequality  Is 

sharpest  for  the  smallest  a  for  which  Condition  I  holds.  If  r  (n)  approaches 

a 

a/n  ,  Che  smallest  a  for  which  Condition  I  holds  Is  a  *  ISie  sane  situation 

o 

is  true  with  respect  to  the  generalized  Schlaifer's  inequality.  Clearly, 

if  Condition  II  holds  for  a  =  a  ,  it  holds  for  all  a  S  0!  and 

o  o 

Lenoa  2.3*1«  ■  For  fixed  3,  n  ,  and  n  (n  ^  n  ),  (a/(a  +  p))  (n/n 
■  I  I  I  o  o  o 

+  (p/(a  +  P))  (n^/n)  is  an  Increasing  function  of  a.  (Note  that  for  n  =  n^, 

(a/(a  +  P))  (n/n  +  (p/(a  +  p))  (n  /n)*^  =  1  for  all  a  and  p.) 
o  o 

Proof;  Let  r  =  «  +  p  and  x  =  n^/n.  It  Is  Strai^tforwurdjto JbWi.tlttkt 

^  /  0!  /n_|^  +  p  f  I!®  1°^]  =  (x‘^-1  -I-  Ylnx). 

3aa  +  pn^|  a  +  p  \n  l 

I  \  Ol  \  I  I 


The  conclusion  will  follow  If,  for  all  f  >  0  and  x  >  0  (x  ^  l) 
x”^  -1  +  Trlnx>0. 

Now,  for  any  y  >  0 


3  (x"^  -  1  +nn  x)  =  ■pc”''  (1  -  x”') 

5x 


-1 


Is  0  only  If  X  =  1.  And 
^2 
“2 


^ _  (x'^  -  1  +  r  (x"^(r  +  1)  - 


(2-38) 

(2-39) 


(2-hO) 


=  r  >  0. 

Therefore,  x”^  -  1  +  ylnx  >  0  for  all  y  >  0  and  x  >  0  (x  ^  1% 

Proof  of  Theorem  2.3.2;  Let  ti  =  p(a  +  P)~^  n^  ^(%)  “ 

a(ci(  +  P)”^  n"^  r(n  ).  Then  cn  +  dn^  =  r(n  )  and  (r(n  ))"^  (cn"^  +  dn^) 
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Q!  +  P  I  "  / 

Hence,  the  conclusion  of  the  theorem  is  equivalent  to 
r(n)  =  r  (n)  +  r  (n)  S  cn"^  +  dn^ 

w  8 

or 


(2-lfl) 


r  (n)  -  cn“^  §  dn^  -  r  (n)  =  (d-k  )n^  .  (2-42) 

u  S  8 

From  Condition  I  and  Theorem  2.3.1,  r.(n  )  +  r  (n  )  >  (p/a)r  (n  )  +  r  (n  ), 

Co  so  80  80 

or 

a(a  +  3)"^  r(n^)  >  •  (2-43) 

Therefore 

d  =  a(oi  +  ^)~^  n"^  r(n  )  >  n"^  r  (n  )  =  b  (2-44) 

'  o  '  o  o  s'  o 

and,  from  (2-42),  the  conclusion  of  the  theorem  Is  equivalent  to 


-a 


r  (n)  -  cn‘ 

q(n)  =  - - -  S  1. 


(2-45) 


From  the  definitions  of  c  and  d,  <l(ii^)  =  1.  It  will  be  shown  that 
q(n)  £  1  by  showing  that 

dq(n)/dn  ^  0  for  n  ^  n^  .  (2-46) 

Let  q'(n)  =  dq(n)/dn  and  r^  (n)  =  dr^(n)/dn.  It  Is  easily  shown  that  q'(n) 
may  be  written  as 

,■(.)  -  [(„'“!  r;(«)  .  . 

^^"o*^t^"o^  -  n®r^(n))],  (2-4?) 

From  Condition  I 

n^'^rj.(n^)  -  n“rj.(n)  ^  0  for  n  |  n^  .  (2-48) 

Hence,  from  (2-48)  and  (2-47),  (2-46)  will  certainly  be  true  If 

r'(n)  +  pk  n  >  0  for  n  S  n  .  (2-49) 

since  n  Is  a  stationary  point  of  r(n),  r'  (n  )  =  -6k  n  and  the  left 
o  t  o  so 

hand  side  of  (2-49)  Is  0  for  n  =  n^.  Hence,  (2-49)  will  be  true  If,  for 
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all  n  >  0 


or,  if,  for  all  n  >  0 

(n°^^r^  (n))  <  0  (2-50) 

which  is  Condition  II. 

Corollary  1.  If  r  (n)  =  0  for  n  =  0  and  K_  +  k_n^  (K_  >  0) 

S  8  S  S  “ 

for  n  >  0,  Conditions  I  and  II  are  sufficient  for  the  generalized  Schlaifer's 
inequality. 

Proof:  Let  r  (n)  =  k  n^.  Then  n.  also  minimizes  r(n)  =  r^(n)  +  r.(n) 

3  S  O  w  8 

and  r(n)  =  r(n)  -  K^.  Prom  the  theorem,  ?(n)/?(n^)  <  (a/(c»fp))  (n/n^)^  + 
(3/(c»fP))  (n  /n)®,  tad 


linl  .  — <Zl2il 

r(n^)  ?(n^)  +  “  ?(a^) 


(2-51) 


since  r(n)  >  r(n^) . 

Corollary  2.  If  r.(n),  r_(n),  ajod  r(n)  are  defined  as  in  Corollary  1 
8  8 

and  n^  -  0  and  n^  «  the  value  of  n  which  minimizes  r(n)  is  >  0,  then  Condi¬ 
tions  I  and  II  are  sufficient  for  the  inequality 


r(n)  ^  ^^"o^  r  o  /  “1  ^  I  P  f'' 

TTo)  [SlTp  \B^|  +  STTlr)  J  -^2-52) 


Proof;  Since  r(n)  =  r(n)  +  and  r(n)  /  r(n^)  <  (a/(cH^))  (n/n^)^ 
+  (s/(ciH^))  (n  /n)® 


rin 

r(0 


K 


^^“o^  nn 


r(o)  r(0) 


<  ^s  +^^"o^  r  g  (n\^  +  6  f°o\° 

r(o)  r(o)  jjJ  +  ^  (^n^  j  g  +  p  ^  n  J 
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Theorem  2.3.3 ♦  If  Condition  II  is  true  and  dr^(n)  /dn  =  o(n”^) 
then  Condition  I  is  true,  for  the  same  a  for  which  Condition  II  is  true. 

Proof:  As  n  tends  to  <*> 

,  nr^'(n)  +  ar^(n)  -4  0  (2-53) 

by  the  second  part  of  the  hypothesis  and  regularity  property  (i)  (2-29). 

Now 

d(^nr^'(n)  +  ar^(n)j  /dn  =  n"^  d^n*^”*^^  r^'(n)j  /dn  <  0  (2-5^) 

by  Condition  II  (2-36).  Hence 

nr^'(n)  +  CKr^(n)  =  n^"°^  d^n*^rj.(n))  /dn  >  0  (2-55) 

which  implies  that  Condition  I  (2-31)  is  true. 

2.k  Two  -  Action  Problems  on  the  Mean  of  a  Normal  Process 
2.4.1  Process  Precision  Known,  Linear  Terminal  Losses, 

Sampling  Costs  =  K^  +  n^,  */ 

Normal  Prior  Distribution  of  Process  Mean 
This  problem,  specialized  to  the  case  of  sampling  costs  proportional 
to  n,  is  the  problem  summarized  in  Section  2.2  and  the  problem  for  which 
Schlaifer  conjectured  Schlaifer's  Inequality.  The  proofs  of  the  generalized 
inequalities  for  the  problenrof  this  subsection  Involve  dr^(n)/dn  and 
d^r^(n)/dn^  ;  since  they  are  quite  complicated,  they  will  be  calculated 

first.  It  will  then  be  shown  that  r^(n)  has  properties  (i)  and  (ii)  and 
that  the  generalized  inequalities  are  true  for  this  problem  (assuming 
K^  =  0  for  the  partition  inequality). 


«/ 


In  Sections  2.4  and  2.5,  r  (n)  g  0  for  n 
abbreviated  to  r  (n)  =  K  f  k  n^. 

B  0-6 


0  and  K  k. 

s  a 


for  n  <  0  is 
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(2-56) 


Lenna 


Proof: 


where 


Now 


Hence 


Next 


For  rj.(n),  as  given  by  (2-58)  below, 


dr  (n)  k  f  in*)  ,  .1 

’  _  t  N*'‘‘^  >  /  n' 


d^r  (n) 

V(”)  - 


1-^  1‘ 

\  hn  n/ 


4n+n'  -  n'D* 
- ^ - 


(¥^). 


(2-57) 


From  Section  2.2 

=  k^(hn')  2  I^^(D')  -  kj.(hn*)“2  1^^(d*)  (2-58) 


n*  =  n'n'Vn  ,  n"  =  n'+n  ,  D'  =  (hn')2  | 


(2-59) 


^  ’ 


i/_2_  -  1  InJ  \ 

2(n'n"/  (n  / 


dn*  _ 
dn 

dD*  D*  dP*  D-ifn  n'‘ 


dn*  Sn*  *  dn 

dLjj^(D*) 


n'D* 

2n"n 


dD*  ”  ■  S*^°*^  ’  dn 


2irn"  n®  “  ■  Pn^rT  (2-6o) 


■2n^ 


r'^(n)  =  . 


I 


_t  1  „».■  , , 

hS  dn  ■'■  dn  ^*(P*' 


kt  L  U  n'D*G^^(D*) 


N*' 
~2^ 


k"  (m) 


W°*)  /„.  i 

2n"  (hn"n  , 
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r,"(n)  = 


(n) 


dn 


^  I  -I 

+  Ji-%  n"^  ^ - 

dn  dn 


=  r^"(n) 


,.3/2 


2il 


372  ■  3372 


2n" 


,/  \  4n+n'-n'D* 

=  -  r^’(n)  - 


2n"n 


Lemma  2.4.2.  r^(n),  as  given  by  (2-58),  has  properties  (i)  and  (ii) 

Proof:  From  (2-56),  property  (i)  is  obvious.  From  (2-57)»  since 

2 

r^*(n)  <  0  ,  (n)  has  the  same  sign  as  (4n+n'-n'D*  ),  From  the 

definitions  of  D'  and  D*  (2-59) 


(4n+n' 


n'D#^)  =  (1/n)  (kn^+nn*  (1-I>'^)  -  n'^D'^)  (2-6l) 


which  is  0  for 


n  =  (n'/8) 


(1-D’^)  t  (l6  D’^  + 


(2-62) 


From  (2-6l)  and  (2-62)  it  is  clear  that  r^(n)  has  property  (ii). 

Theorem  2.4.1.  The  generalized  optimal  loss  partition  inequality 
and  the  generalized  Schlaifer's  inequality,  both  with  a  =  1,  are  true  for  the 
two-action  problem  on  the  mean  of  a  Normal  process  of  known  precision  with 

O 

linear  terminal  losses,  san^llng  costs  =  *  snd  a  Normal  prior 

distribution  of  the  process  mean. 

Proof;  From  Theorems  2.3.1  -  2.3.3  it  suffices  to  show  that  r^  (n)  =  o(n"  ) 
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and  that  Condition  II  is  true.  From  (2-^9) >  ^ 

D* — >D'  .  Hence,  from  (2-56) 


00 ,  n*  n ' ,  and 


r^'(n)  =  o(n'^)  .  (2-63) 


Condition  II  requires  that  d(n  r^'(n))/dn  <  0,  or,  for  a  =  1 

n(nr"  (n)  +  2r^  (n))  <  0  .  (2-64) 


From  Lemma  2.4.1 


nrj."(n)  +  2rj.'(n)  = 


(n'D*  -n'-4n)/2n"  +  21 


= 


(n'D*  +  3n')/2n" 


(2-65) 


which  is  negative  since  r^'(n)  is  negative.  Hence,  Condition  II  holds 

for  a  =  1;  it  is  easily  shown  that  it  does  not  hold  for  a  <  1. 

—  ••ft 

Corollary.  If  ^^(n)  =  Kg+rg(n)  where  ^^(n)  =  >  then 

Ci:rj.(n^)  >  pr^(n^)  and  the  generalized  Schlaifer's  Inequality  is  true 


with  a  =  1.  If  n  minimizes  r  (n)  +  r  (n)  and  is  >  0  while  n  =  0 
o  t'  '  s'  ^  o 


/  %  K  r(n  ) 

r(o)  -  r(o;  r(o) 


;  n  \a 


(2-66) 


with  a  =  1. 

Proof:  The  first  statement  follows  from  Corollary  2  to  Theorem  2.3. 1 
and  Corollary  1  to  Theorem  2,3.2.  The  second  statement  follows  from 
Corollary  2  to  Theorem  2.3.2. 

2.4.2  Process  Precision  Unknown,  Linear  Terminal  Losses,  Sampling  Costs  =  K^+k^n^, 
Normal  -  Gamma  Prior  Distribution  of  Process  Mean  and  Precision. 

In  this  subsection,  it  will  be  shown  that  the  generalized  optimal  loss 


s  s 


partition  inequality  (if  Kg=0)  and  the  generalized  Schlaifer's  inequality. 
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both  with  a  =  1,  can  be  extended  to  this  problem  if  the  prior  neon  of  ^ 
is  finite.  The  distribution  theory  for  this  problem  is  given  in  [1]  and  is 
sumnarized  below.  Methods  for  finding  the  optimal  sample  size  for  the  case 
of  0  =  1  are  given  by  Schleifer  [4]. 

Let 

^  =  mean  of  a  Normal  process  of  unknown  precision  h 
prior  distribution  of  (p,  K)  =  f^^  (p,  h|m',  v',  n',  v') 

=  fj^(plm',  h  n’)  f^,  (h|v’,  v’)  where 


')  «  ('■(i  v'))"^  ,  -ihv'v' 


(2-67) 


-  •^Pj  m'  <«,  h>0;  v',  n'>  0|  v'  >  1. 

(The  prior  marginal  mean  of  p  is  finite  only  if  v'  >  1.) 

The  definitions  of  A,  u^(a^,  p),  p^,  k^,  and  fj^(p|m',  hn')  are  given 
in  Section  2.2. 

If  m'  <  pj^ 

r^(n)  ^  r^(0)  -  v^(n)  (2-68) 


where 


:t(0)  =  J*  fs(4|“»'»  n'/V,  V’)  dp 


(2-69) 


J'  (®""^^b^  n*/v',  v')dm"  (2-70) 


fg(p|m,  n/v,  v)  =  (v^/B(i,iv))  +  (n/v)(p-m)®  ■^^'''’’^^n/v)^  (2-71) 


B(^.  ^)  =  beta  function  of  arguments  j  and  ^  V 
and  n*,  n”,  m",  and  n  are  defined  by  (2~2^)  and  (2-27). 
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Let 


D-'  =  (n'/v')^  D*=(n*/v')^  • 


Then  r^(0),  given  by  (2-6$),  can  be  written 

^tCO)  =  k^(v'/n'}2  Lg^(D'lv') 
and  v^(n),  given  by  (2-70),  can  be  written 

Vj.(n)  =  kt.(v'/n*)2  Lg^(D*|v') 


where 


Ls^f(D|v)  =  ((v+d2)/(v-1))  fg^,(D|v)  -  DCg,(D|v) 

fs*(D|v)  =  ^(D(0,  1,  v) 

Gg*(D|v)  =  y** fs*(t|v)  dt  . 


■(.(n)  =  kj.(v'/n')^  Lg^(D’lv')  -  kj.(v7n*)2  L  (D*|v') 


Lemaa  2.U.3.  For  r^(n),  as  given  by  (2-78), 

r  _  1,  f  v'_  )  n'  v'+D*^ 


•1  . 

(2-72) 

(2-73) 

(2-74) 

^(d|v) 

(2-75) 

(2-76) 

(2-77) 

Hence  for  any  m'  , 

(D*|v')  . 

(2-78:) 

(2-79) 

a  .  j 

(2-80) 
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Proof;  From  (2-78) 


Now 


•t(n)  =  k^(v'/n')2  Lg^(D'|V)  .  kjv'/n*)2  Lg*(D*|v') 


dn* 

dn 


dn 


d  D* 


dGg^(D*lv') 


dD* 


1 

d(n/n'n")^  1 

1°' 

dn  ■  ^ 

d^(n*/v')2jn^_ni'|j| 

dn 

* 

2n''n 

1  -  ±_Yv^’ 
dD*\  B(i,^') 

’  t 

-  =  - 

(2-81) 


<iL-„(D*|v') 


^  d  /v'+D*®  .  ,  .  .  \ 

=  +  D*j  -  Gg^(b*lv’) 


=  -Gg>*|V)  . 


Therefore 

(n)  = 


=  -  k 


t'^  2H»^  -  (to)  ^ 


( n'  1  v'+D**  ,  I 


C  n'  v'+D*^ 

t  \  a*j  2n"n  v'-l 


fs*(D*|v')  . 
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And 

r/(n)  =  r  '(n)^^  ^n7_2r^  ^  d(n/n»i^j 

t  '■  '  t  '  ^  '  IT  dn  \  n  /  dn 

\  *■■  • 

1  v'-l  d^(v'+D#^)/(v '-!)') 


=  r 


t 


n"+n  n* 
n"n  ^  2n''n 


n’D*  (v'+l) 

- 5 

2n"n(v'+D*  ) 


.  2  \ 

2n'D* 

2n"n(v'+D*^)  j 


=  r^'(n) 


1 

2J?^ 


/  V '+D*^  \ 

\y^) 


Lemma  2.4.4.  If  v'  >  1,  r^(n)»,as  given  by  (2-78)  has  properties 
(1)  (2-29)  and  (ii)  (2-30). 

Proof:  Property  (i)  is  obvious  from  (2-79).  From  (2-8o),  since 
r^'(n)  <  0,  r^“  (n)  has  the  same  sign  as 

4n  -  n’  -  n'D*^  ((v '+D*® )/(v ' -l))  .  (2-82) 

1 

From  the  definitions  of  D*  and  D'  (2-72),  D*  =  D'(n*/n')^  .  Substituting 
this  for  D*  in  (2-82)  and  rearranging  gives 


^n®(v '-1)^'^  [4(v '-l)n^-n'  (D'^+V  *D'^-v '+l)n^-n'^D’^(2D'^+v ' )n-n'^D'*^]. 


By  Descartes's  rule  of  signs,  this  quantity  is  0  for  exactly  one  positive 
value  of  n  if  D'  ^  0  ;  if  D'  =  0,  it  is  positive  for  all  n  >  0.  In  either 
case,  it  is  clear  that  r^(n)  has  property  (ii). 

Theorem  2.4.2.  The  generalized  optimal  loss  partition  inequality 
and  the  generalized  Schlaifer's  Inequality,  with  a  =  1,  are  true  for 
the  two-action  problem  on  the  mean  of  a  Normal  process  of  unknown  precision 


2-83) 
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with  linear  terminal  losses,  san^jling  costs  =  k  n^,  and  a  Normal  -  gamma 

8 

prior  distribution  of  the  process  mean  and  precision  with  finite  prior 
marginal  mean  of  the  process  p  (v'>l). 

Proof:  The  proof  of  this  theorem  parallels  exactly  the  proof  of 
Theorem  2.4.1.  From  (2-79)  ^od  (2-8l)  it  is  easily  seen  that  r^'(n)  =  o(n'^). 
Also  from  Lemma  2.4.3. 


nr^"(n)  +  2r^'(n) 


r^'(n) 

“an" 


'  2 
V'+D* 

v'-l 


\ 

-  n'-4n+4n" 

/ 


rj.'(n) 

“2n" 


/v'+D*^ 


+  3n' 


which  is  negative  since  v '>1  and  r^'(n)  <0. 

Cotollary,  The  corollary  to  Theorem  2.4.1  holds  without  .change. 


2.4.3  Process  Precision  Known,  Quadratic  Terminal  Losses, 

Sampling  Costs  =  Kg  +  K^n^,  Normal  Prior  Distribution  of 
Process  Mean  with  Mean  m'  =  Breakeven  Value  of  Process  Mean, 
This  problem  has  not  been  considered  elsewhere.  The  assumption  that  , 
m'  =  makes  the  problem  quite  specialized  but  results  in  a  simple 
expression  for  r.(n);  for  m'  p.  ,  r^(n)  is  more  complicated.  The 

t  D  C 

problem  does  provide  an  exanple  of  a  Bltu&tloh  jfor  which,  thp  gttaetftllzed 
inequalities  are  true  for  an  a  ^  1. 

The  notation  closely  follows  that  of  Section  2.2.  In  particular, 
thft  nqt«tlottu(a«fiL^i.tl£oQuc)».  Jbe  ..utllKAd.. .  } 

^■'.c  o.:  a..’  .  (2-i4).  '.l':  ) 
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and  r(n)  be  defined  as  in  (2-19)  (2-20)  and,  for  the  moment,  let 

rg(n)  =  k^n^.  Assume  that  action  is  preferred  if  n  <  and  action 
is  preferred  if  and  that  the  terminal  loss  if  obtains  is 


0  if  n  <  (>)  and  a^  (a^)  is  taken 
k^(p  -  4j^)^  otherwise  (k^  >  O)  . 


(e-85) 


Without  loss  of  generality  assume  that  4^ 


0. 


In  Section  2.2  and  subsections  2.4.1  and  2.4.2,  r^(n)  was  written  as 
the  difference  between  r^(0)  and  the  prior  expected  terminal  loss  of 
taking  the  action  optimal  under  the  prior  distribution  following  a  sample 
of  size  n.  In  this  subsection  it  is  convenient  to  write  r^(n)  in  the 
more  easily  Interpreted  form 


=  J m)  D^(m)  dm 


(2-86) 


where 


r^(n,  m)  =  expected  terminal  loss  of  an  optimal  terminal 


(2-87) 


decision  posterior  to  observing  a  sample  mean  of  m 
from  a  sample  of  size  n. 

D^(m)  =  marginal  density  of  ra  for  a  sample  of  size  n.  (2-88) 

Raiffa  and  Schlaifer  [1,  Chapter  4]  show  that  tlie  two  forms  of  r^(n) 
are  equivalent, 

^It  is  also  shown  in  [l]  that 
*****  * 

D^(m)‘=*fjj(mfm',  -hn^>-  =  hn^)  '  '(2-89) 

•  ..  •  ’•*  ' " 

where 


n'n/n".  (n"  =  n'+n) 


(2.90) 
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Hence,  from  (2-24),  (2-85),  and  (2-87) 


rt(n,m)  =  ^  ^ 


fj^(|i|m",  hn")d|i  If  m"  <  0 


fj^(n|m'',  hn")d4  if  m"  > 


(2-91) 


where,  as  in  (2-25),  m"  =  (n*m*  +  n  m)/n"  =  nm/n"  (since  m'  ■  =  O). 

Since  m"  <  0  if  and  only  if  m  <  0,  (2-86)  becomes,  using  (2-89)  and  (2-9l) 

O  00 

-00  o 

00  'lO 

+  J  J'  ^")  (2-92) 

O  -00 


00  O 

=  2k^.  /  /  m",  hn")  fjj(m)j  0,  hn^)  d^  dm. 

O  -00 

X 

Letting  D"  «  (hn**)^  m**,  it  is  straightforward  to  show  that 
o 

f  42fj,(n|m",  hn")  d^i  =  (hn")-^  [ (1+D"2)G^^,(D")  -  D"fj,*(D")]  •  (2-93) 

-00 

Hence 

00 

r^(n)  =  2k^(hn")-^  J  [(l+D"®)  Gj,^(D")  -  D"fj,^(D")]fj,(m|0,hn^)dm 

o 

and, ..letting  x  =  (hn^)*^  m  and 

p  =  p(n)  =  (n/n')^  (2-94) 
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D"  reduces  to  px  and  r^(n)  may  be  written 

00 

r^{n)  =  2k^(hn")"^  J  [(l+p^x^)  Gj^^(px)  -  pxfj^(px)  ]fjj^(x)dx 


(2-95) 


=  2kjhn")“^  (I^+Ig+I^) 


where 

00 

=  J  Gjj*(px)  (2-96) 

o 

00 

Ig  =  Gj^^(px)  fjj*(x)  dx  (2-97) 

o 

00 

I3  =  J  px  ^  *  (2-98) 

o 

It  is  well  known  that 

=  lA  -  (&7r)‘^  tan"^  p  =  (27r)‘^  tan"^  p‘^  .  (2-99) 

and  it  Is  easily  shown,  by  transforming  to  polar  coordinates,  that 

I2  =  p^(27r)‘^  -  p(l+p^)’^  -  tan’^  p].  (2-lGO) 

It  Is  also  easy  to  show  that 
=  pn'/2rm" 

Using  (2-99)  through  (2-101)  In  (2-95) »  rj.(n)  reduces  to 
rj.(")  =  Ck^/irhn')  (^  -  p(l+iJf )”^-tan"^p)  . 

Now 

dp/dn  =  l/2an'  ,  dr^(n)/dp  =  -2k^/Trhn '  ( 1+p^)^  (2-103) 

and  r^'(n)  reduces  to 


(2-101) 

(2-102) 
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(2-104) 


r^'(n)  =  -k^/TThpn"®  . 

From  (2-104),  regularity  property  (i)  (2-29)  l-s  obvious. 

Also,  r^"(n)  reduces  to 

r^"(n)  =  -(1/2)  (1/n  +  4/n")  r^'(n)  (2-105) 

from  which  regularity  property  (ii)  is  obvious. 

Theorem  2.4.3«  The  generalized  optimal  loss  partition  inequality 
and  the  generalized  Schlaifer's  inequality,  both  with  a  =  3/2,  are 
true  for  the  two  -  action  problem  on  the  mean  of  a  Normal  process  of 

a 

known  precision  with  quadratic  terminal  losses,  sampling  costs  =  k^n^, 
and  a  Normal  prior  distribution  of  the  process  mean  with  mean  m'  = 

Proof;  From  Theorems  2.3.1  -  2.3.3,  it  suffices  to  show  that 
t^'  (n)  =  o(n  ^)  ,  and  that  Condition  II  holds  with  a  =  3/2.  From  (^2-94) 
and  (2-104)  it  is  obvious  that  r^' (n)  =  o(n)^)  . 

Condition  II,  with  ft  =  3/2,  is  dn^^^  r^'(n)/dn  <  0  ,  or  equivalently 

nrj."(n)  +  (5/2)  rj.’(n)  <  0  .  (2-106) 

Using  (2-105) 

nr^"(n)  +  (5/2)  rj.'(n)  =  2n’ r^. '  (n)/n"  (2-10?) 

which  is  negative  since  r^'(n)  is  negative. 

Corollary.  The  corollary  to  Theorem  2.4.1  holds  with  =  1  replaced 
by  a  =  3/2. 
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2.4.4*.  Process  Precision  Known,  Simple  Terminal  Losses  (O  for  correct 

action,  1  for  wrong  action).  Sampling  Costs  =  K  +  k  n  ,  Normal  Prior 

s  s 

Distribution  of  Process  Mean  with  Mean  m'  =  Breakeven  Value  of  Process 
Mean. 

The  analysis  of  this  problem  is  very  similar  to  that  of  subsection 
2.4.3*  fact,  if  the  second  line  of  (2-85)  is  replaced  by  "1 .otherwise," 
the  discussion  in  subsection  2.4.3  applies  without  further  change  through 
(2-90).  The  expressions  in  (2-91)  and  (2-92)  apply  with  the  "k^u^"  factor 
replaced  by  "1 ,"  i.e. , 

00  o 

r^(n)  =  2  J'J' fjj(tJi|m",  hn")  fjj(mjO,  hn^)dpdm  .  (2-108) 

o 

It  la  easily  shown  that  (2-108)  reduces  to 

00 

=  2^  Gjj^(px)£jj^(x)dx  (2-109) 

o 

i 

where,  as  in  (2-94),  p  =  (n/n')^.  Hence,  from  (2-96)  and  (2-99) 

r^(n)  =  TT*^  tan"^  p"^  .  (2-110) 

Now,  it  Is  straightforward  Co  show  that 

rj.'(n)  =  -(2Trpn")'^  (2-111) 

rj."(n)  =  -rj.'(n)  (l/2n  +  1/u’))  (2-112) 

from  which  it  is  clear  that  r^(n)  has  regularity  properties  (i'  (2-29)  and 
(ii)  (2-30). 

Theorem  2.4.4.  The  generalized  optimal  loss  partition  inequality 
(if  Kg=0)  and  the  generalized  Schlaifer's  inequality,  both  with  a  =  1/2,  are 
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true  for  the  problem  of  this  subsection. 


Proof :  From  Theorems  2.3.1  -  2.3.3t  it  suffices  to  show  that 

=  o(n”^)  and  that  Condition  II  is  true.  The  former  is  obvious  from 
the  definition  of  p  and  (2-111).  Condition  II  requires  that 
d(n“‘^^rj.'  'n))/dn  <0.  For  a  =  ^, 

d^n^^^r^' (n)y/dn  =  n2[n(^r^' (n)J)  (l/2n+l/n’' )+(3/2)r^' (n)  ]  (2-113) 

from  (2-112)^  and  this  reduces  to 

d(n'''"rj.' (n))/dn  =  r^.' (n)  (n'n)^/n"  (2-114) 

which  is  negative  since  r^*'n)  is  negative. 

Corollary.  The  corollary  to  Theorem  2.4.1  holds  with  a  -  1  replaced 
by  a  =  j  . 


2.4.5  The  Problem  of  Subsection  2.4.4  with  an  inJi lerence  Kegion 


about  u. 

D 

If  the  terminal  loss  function  of  the  last  subsection  is  changed  to  : 
terminal  loss  if  ^  obtains  equals 


if  M  is 


/ 

1 


S. 


<  c  and  a^ 
>-c  and  a  , 


is 

is 


taken 

taken 


1  otherwise 


where  c  is  a  positive  constant,  then 

00  -c 

r^(n)  =  2  j  j  f^(M|m'',  hn")f|^,(m|0,  hn^)dMdm  .  (2-115) 

O  •oo 

Standardizing  (2-115)  results  in 
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r|.(n)  =  2  J  F^^(^-p(cy(hn*>f  x))  f^^(x)dx  .  (2-116) 

o 

Hence 

rj.(n)  <  Fj^(-P9  (hn*t'  ).  (2-117) 

Since  p9  (hn*^  O(n^) 

r^(n)  =  o(n"^)  (2-118) 

for. any  fixed  a  >  0  . 

It  is  noted  in  Chapter  1  that  if  a/n  +  bn^  is  minimized  by  n^,  then 

CK  ft 

a/n^  =  (3/a)bn^  .  For  the  problem  of  this  subsection  with  any  3  >  0,  it 

is  clear  that  r^(n^)/rg(n^)  approaches  0  as  n^  tends  to  infinity,  which 
will  take  place  if  K  s  0  and  k  tends  to  0.  Hence  the  generalized  optimal 

S  8 

loss  partition  Inequality  with  any  fixed  Cl  and  3  Is  not  necessarily  true. 

It  can  be  shown  that  for  any  fixed  a,  the  generalized  Schlaifer's 
inequality  can  also  be  false. 

The  contrast  between  the  results  of  this  subsection  and  the  results 
of  subsections  2.U.1  through  2.k.k  illustrates  that  for  the  type  of  two- 
action  problems  being  discussed,  asymptotic  results  depend  critically  on 
whether  or  not  the  terminal  loss  function  is  0  throughout  a  neighborhood 

of  • 

2.5  Estimation  Problems 

a 

2.5.1  Quadratic  Terminal  Losses,  Sampling  Costs  =  K^+k^n^ 

In  this  subsection  it  will  be  shown  that  the  generalized  optimal 
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loss  partition  inequality  (if  K  =0)  and  the  generalized  Schlaifer's 

8 

inequality,  both  with  a  =  1,  are  true  for  several  fixed  san^ile  size 

tfzaijkal  lots  estidatloa  prohlau  toiislawA  In :  . 

Section  6.3  of  [1].  Results  will  be  given  here  only  for  the  case 

K^=0  .  The  corollaries  to  Theorems  2.3.1  and  2.3.2  are  again 

applicable  and  give  inequalities  for  the  case  K  >0  . 

s 

Let 

oj  =  parameter  being  estimated  (2-119) 

T]  =  "sample  size"  (the  reason  for  this  definition 

(2-120) 

will  be  clear  from  a  reading  of  the  problems  below) 

(Sr'=  prior  variance  of  Q  (2-121) 

S''(fl))  =  prior  expected  value  of  the  posterior 

(2-122) 

variance  of  S  following  a  sample  of  size  4  ' 

It  is  shown  in  [1]  that  if  the  terminal  loss  of  estimating  u  by  a  is 
k^(a-u))®  where  k^X),  then  r^(q)  =  k^u"(q).  Hence,  if  r^(r))=k^T^ 
where  kg>0  and  p>0 

r(Tj)  =  kj.«*'(T))  +  .  (2-123) 

For  all  the  problems  considered  here,  Ralffa  and  Schlalfer  [1]  give 
expressions  for  the  posterior  expected  value  of  u,  which  is  the  optimal 
estimate  of  u,  expressions  for  1S"/IS',  and  optimality  conditions  for 
the  case  6=1  from  which  the  optimal  sample  size,  can  be  determined. 
The  optimality  conditions  for  can  easily  be  extended  to  the  case 
6^1.  It  is  assumed  in  [1]  and  will  be  assumed  here  also  that  H*  is 
finite. 
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The  estimation  problems  for  which  Theorem  2,^.1  below  proves  that 
the  generalized  inequalities  are  true,  along  with  some  necessary 
results  from  [1],  are  as  follows: 

(1)  Let  u)  be  the  paranmter  p  of  a  Bernoulli  process  and  assume  that 
the  prior  distribution  of  u  is  a  beta  distribution  with  parameters 
r'  and  n'-r'.  Let  the  experiment  be  the  observation  of  n  (n=T)) 
trials  and  let  r  denote  the  number  of  successes  observed.  Then  the 
posterior  distribution  of  S  is  beta  with  parameters  r"=r'+r  and 
n"-r"  where  n"=n'+n.  The  optimal  estimate  of  w  is  r"/n"  and 
8"/a'  =  n'/n"  . 

(2)  Let  u  be  1/p  and  the  process  and  prior  distribution  of  p  be  as  in 

^  (1).  Let  the  experiment  be  the  observation  of  the  process  until 

r(r=:T))  successes  occur  and  let  n  denote  the  number  of  trials  necessary. 

The  optimal  estimate  of  u  is  (n”-l)/(r"-l)  and 
5" /a*  =  (r'-l)/(r"-l).  For  u'  <  »  ,  r'  must  be  >  2. 

(3)  Let  be  the  parameter  \  of  a  Poisson  process  and  assume  that  the 

prior  distribution  of  u  is  gainna-1  with  parameters  r'  and  t',  i.e., 

f  (u)|r',  t')0C  u)  "  .  Let  the  experiment  be  the  observation 

^1 

of  the  process  for  a  time  t  (t=q)  and  let  r  denote  the  number  of  successes 
observed.  Then  the  posterior  distribution  of  10  is  gamma-1  with 
parameters  r'sr'+r  and  t"=t'+t.  The  optimal  estimate  of  oj  is 
r"/t"  and  S'Vtf'  =  t'/t". 

(4)  Let  u,  the  process,  and  the  prior  distribution  be  as  in  (3)  but 
assume  the  experiment  is  the  observation  of  the  process  until  r(rsq) 
successes  occur.  Let  t  denote  the  time  necessary  for  this.  The 
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optimal  estimate  of  w  is  again  r"/t"  and  S"/i5'  =  (r'+l)/(r"+l). 

(5)  Let  (1)  be  l/\  where  the  process,  and  the  prior  distribution 
of  X.  are  the  same  as  in  (3)  end  the  experiment  is  the  same  as 
in  (4).  The  optimal  estimate  of  u  is  t"/(r”>l)  and 

8" /(S'  =  (r' -l)/(r"-l).  For  <2*  <  »,  r'  must  be  >  2. 

(6)  Let  GJ  be  the  mean  4  of  a  Normal  process  of  known  precision  h 
and  assume  that  the  prior  diftribution  of  o)  is  Normal  with 

mean  m*  and  precision  hn* .  Let  the  experiment  be  the  observation 
of*  a  sample  of  n  (n=T])  and  let  m  denote  the  sample  mean.  Then 
the  posterior  distribution  of  u  is  Normal  with  mean  m”  and 
precision  hn"  where  n"  =  n'+n  and  m"  =  (n'm'+nm)/n’'.  The  optimal 
estimate  of  is  m"  and  8" /S'  =  n'/n"  . 

(7)  Let  (ii  be  the  precision  h  of  a  Normal  process  of  known  mean  p  and 
assume  the  prior  distribution  of  u  is  gamma>2  with  parameters  v’ 

and  v',  i.e.,  f  (w(v',  v')  CC  h^  .  Let  the  experiment 

-1 T’ 

be  the  observation  of  a  sample  of  v(v=tj)  and  let  w  =  v”  y  . 

Then  the  posterior  distribution  of  0  is  gainna-2  with  parameters 
v"  =  v'+V  and  v"  =  (v'v*+vw)/v”.  The  optimal  estimate  of  u  is  1/v" 
and  3"/u'  =  (v'+2)/(v"+2). 

mm 

(8)  Let  h)  be  1/h  where  the  process,  prior  distribution  of  h,  and  the 
experiment  are  the  same  as  in  (7).  The  optimal  estimate  of  u  is 

v9v"/(v"-2)  and  =  (v '-2)/(v"-2).  For  v'  must  be  >  4. 

(9)  Let  u  be  the  mean  ^  of  a  Normal  process  of  unknown  precision  h 
and  assume  the  prior  distribution  of  (|I,  h)  is  Normal-gamma  with 
parameters  m' ,  v',  n',  and  v'  (see(2-67)).  Let  the  experiment  be 
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the  observation  of  a  sample  of  size  n  (n=T))  and  let  m,  m" ,  and  n"  be 
defined  as  In  (6).  Let  v"  =  v'+v-l  and  v"=i^v'v'+n'm'‘'+vv+nm^-n"m"*")/v" 
Then  the  marginal  posterior  distribution  of  p  Is  fg(^|m",  n"/v",  v") 
(see  (2-7l))i  the  optimal  estimate  of  oi  Is  m"  and  (5"/i3'  =  n'/n"  , 

(lO)  Let  ii)  be  h  or  1/h  and  the  process,  prior  distribution  of  (fl,  h),  and 
experiment  be  the  same  as  in  {9).  The  optimal  estimate  of  w  and  the 
expression  for  (3"/cI)'  is  the  same  as  in  (7)  for  w  =  h  and  the  same  as 
in  (8)  for  oi  =  1/h. 

For  each  of  the  10  problems  above,  w"  is  of  the  form 

S"  =  ^5'(ti’+c)/(t)’+ti+c)  (2-124) 

where  c  is  an  integer  between  -2  and  +2.  Note  that  in  the  problems 
with  c  <  0  (2,  5.  8,  10),  n'+c  >  0  by  the  assumption  that  2'  <  00  . 

Hence,  by  (2-123).  for  each  of  these  problems 

r^Cn)  =  k^w'(Ti’+c>/.(iTi'.+Ti+c)  .  (2-125) 

Since  T^'+c  >  0  and 

r^'(Tj)  =  drj.(T))/d7i  =  -k^2'(Ti'+c)/(Ti'+Tifc)2  (2-126) 

r^(T))  has  regularity  property  (i^  (2-29). 

Since  t)'+c  >  0  and 

r^"(n)  =  d^r^(’l)/dTi^  =  2k^2' ( ti'+c ) /(Ti'+T^fc )^  (2-127) 

r^(’l)  kas  regularity  property  (ii)  (2-30). 

Theorem  2 . 5 ■ The  generalized  optimal  loss  partition  inequality  and  the 
generalized  Schlalfer's  Inequality,  both  with  a  =  1,  are  true  for  all  estima¬ 
tion  problems  with  rg(q)  -  k^q  for  which  r^(q)  can  be  written  as  in  (2-125), 
provided  that  q'+c  >  0.  (For  the  10  problems  above,  q'+c  >  0  if  2'  <.  «>  .) 
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Proof;  As  usual,  the  theorem  will  be  proved  by  showing  that 


r^'(Tj)  =  o(ti"^)  and  that  Condition  II  Is  true.  The  theorem  then  follows 

from  Theorems  2.3. 1  -  2. 3. 3*  Ftom  (2-126)  It  Is  obvious  that 

r^'{Tj)  =  o(t)”^).  Condition  II,  with  a  =  1,  requires  that  d(T)^r^'(Ti))/dT)  <  0, 

or 

Tl^rj."(Ti)  +  2Tir^'(Ti)  <  0.  (2-128) 

From  (2-126)  and  (2-12?) 

n^r^''(q)  +  2Tir^'(q)  =  2iirj.,'(Ti)  (ii'+c)/(n»+iT+c)  (2-129) 

Is  negative  since  r^'(T))  Is  negative,  and  the  proof  Is  consisted. 

Theorem  2.3.1  proves  that  for  each  of  the  10  problems  above, 

>  P  ^^®  simplicity  of  the  expression  (2-125) 

for  r^(Ti),  this  can  be  In^roved  upon.  Since  Is  a  stationary  point  of 
r(q)  and  r^’(Tj)  =  -  r^(Ti)/(Ti'+Tj+c) 

rt(no)/(V+no+c)  =  rg*(T,^)  =  pr^(T1^)/Ti^  (2-130) 

or 

2.3*2  Estimation  of  the  Mean  of  a  Normal  Process  of  Known  Precision, 

a 

Linear  Terminal  Losses,  Saiq>llng  Costs  =  >  Normal 

Prior  Distribution  of  Process  Mean.. 

This  problem,  with  0  =  1,  Is  considered  In  Section  6.4  of  [1]  and 
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sumnarlzed  below.  Let 


|i  =  mean  of  a  Normal  process  of  known  precision  h 
the  prior  distribution  of  jl  be  fjj(4|m*',  hn') 
the  terminal  loss  of  estimating  ji  by  a 
/k^  (a-n)  if  4  <  a,  k^  >  0 
\k^  (n-a)  if  4  >  a,  k^  >  0 

As  in  the  last  subsection,  results  will  be  given  here  only  for  the  case 

K_  =  0.  For  r  (n)  =  k  n  where  k  >0 
S  s'  a  s 

r(n)  =  (k^  +  k^)(hn")‘^f^^(c*)  +  k^n  (2-132) 

where  n"  =  n'+n  and  c*  is  defined  by 

The  optimal  sample  size  n^  is  either  0  or  the  unique  root  of 

n"  =  (2k^)‘^ 

From  (2-I32),  it  is  easily  verified  that 

rj.'(n)  =  -r^(n)/2n'’  (2-135) 

r^"(n)  =  3r^(n)An"^  (2-I36) 

from  which  it  is  clear  that  r^(n)  has  regularity  properties  (i)  (2-29)  and 

(ii)  (2-30). 

Theorem  2,^.2.  The  generalized  optimal  loss  partition  inequality 

(if  K  =0)  and  the  generalized  Schlaifer's  inequality,  both  with  a  =  1/2, 
s 

are  true  for  the  estimation  problem  of  this  subsection. 

Proof;  By  (2-I32)  and  (2-135)  It  is  obvious  that  r^'(n)  =  o(n”^). 
Since,  from  (2-135)  and  (2-I36) 
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(2-137) 


nr^"(n)  +  (3/2)r^»(n) 


3r^(n) 

Ua" 


-3n’r^(n) 


Condition  II  is  true.  Hence,  by  Theorem  2.3.3i,  Condition  I  is  true,  and 
by  Theorems  2,3.1  and  2.3.2,  the  generalized  inequalities  are  true. 


Chapter  III 


As^mgtotic^Ec^ualitie^ 

3.1  Introduction 

In  this  chapter,  several  finite-action  problems  on  the  mean  of  a  Normal 
process  are  examined  under  the  assumption  of  an  absolutely  continuous  (with 
respect  to  Lebesq.ue  measure)  prior  distribution  of  the  unknown  process  para¬ 
meters.  Because  of  the  relatively  weak  assumption  concerning  the  prior 
distribution,  only  large  sample  results  are  available. 

It  is  shown  in  subsection  3 -2.1  that  for  the  two-action  problem 
on  the  mean  p  of  a  Normal  process  of  known  precision  h  with  linear  ter¬ 
minal  losses,  the  expected  terminal  loss  r  (n)  associated  with  a  proposed 
sample  of  size  n  is  asyn^jtotically  proportional  to  n"^.  In  subsection 
3.2.2  it  is  shown  that  for  the  same  two-action  problem  with  quadratic  ter- 
minal  losses,  r^(n)  is  asymptotically  proportional  to  n  THie  same 

problem  with  constant  terminal  losses  is  considered  in  subsection  3.2.3;  in 

“Jl/s 

this  case,  r^(n)  is  asymptoticeilly  proportional  to  n  .  These  simple 
asymptotic  forms  for  r^(n)  make  it  easy  to  derive  asymptotically  optimal 
sample  size  formulas  for  simple  sampling  cost  functions  (Theorem  3.2.2). 

The  generalized  optimal  loss  partition  inequality  and  the  generalized 
Schlaifer's  inequality  become  asymptotic  equalities. 

The  results  of  subsection  3.2.1  are  extended  to  finite-action  problems 
on  the  mean  of  a  Normal  process  of  known  precision  with  linear  terminal 
utilities  in  Section  3.3.  In  Section  3-^  it  is  shown,  under  quite  general 
conditions,  that  if  h  is  unknown  the  results  of  subsection  3.2.1  hold  with 
the  prior  conditional  value  of  h  ^  given  (T  =  (the  breakeven  value  of  ) 
replacing  h'^ . 


-  43- 


3.2  Two-Action  Problems  on  the  Mean  of  a  Normal  Process  of  Known 

Precision  with  an  Absolutely  Continuous  Prior  Distribution  of  the 
Process  Mean 

Some  of  the  notation  employed  in  this  section  was  defined  In  Chapter  2; 
for  ease  of  reference,  it  will  be  repeated  here. 


Let 


A  =  action  space  =  {a^, 

^  =  meein  of  a  Normal  process  of  known  precision  h 

generating  independent  random  variables  Xg, 

-1  ^ 

“  =  “m  =  ^  ill  ^i 

=  prior  density  of  ^ 

D^(n)  =  Dj^(u|m)  =  posterior  density  of 

D^(m|ti)  =  conditional  density  of  m  given  ^  (Normal 

with  mean  and  precision  hn) 

^  CD 

D  (m)  =  marginal  density  of  m  -  J  D  (|i)  D  (m!a)dji 
m  o  c 

m'  =  mean  of  the  prior  distribution  of  'll 

m"  sr  m  "  =  mean  of  the  posterior  distribution  of  u 
m 


(3-1) 


(3-2) 

(3-3) 

(3-4) 

(3-5) 

(3-6) 

(3-7) 

(3-8) 

(3-9) 

(3-10) 


(^^(m)  be  defined  by  m^"  *  4^'®) 

2 

fjj(x|K,H)  =  g-(H/2)(x-M)  ^  ^  (3-11) 

,  F^(x)  =  F^(x|0,  1)  (3-12) 

,  Cj^(x)  -  Gj,  (xlo,  1)  (3-13) 

r^(n)  =  expected  terminal  io»^= ,  prior  tc  observing  m^,  of 


F„(x|M,  H)  =  ;  f„(t|M,  H)dt 

n  .QQ  w 

G  (x|M,  H)  =  1  -  F„(xjM.  H) 

”  II 


an  optimal  decisior  following  a  sample  of  size  n 


(3-14) 
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r  (n)  »  cost,  or  expected  cost,  of  a  sanqple  of  size  n 


(3-15) 


r(n)  =  total  expected  loss  of  a  sample  of  size  n 
=  r^(n)  +  r^(n)  . 


(3-16) 


3.2.1  Linear  Terminal  Losses 

This  subsection  Is  concerned  with  the  case  of  llnesu:  terminal 
utilities,  which  result.  In  the  terminology  of  Ralffa  and  Schlalfer  [1],  in 
linear  terminal  losses.  To  make  this  precise,  let 

u(a^,  =  terminal  utility  of  action  a^  if  ^  obtains 

=  +  k^p  ,  1  =  1,  2  (3-17) 


=  breakeven  value  of  n  =  (K^  -  K2)/(kg  -  k^^) 
k^  =  terminal  loss  constant  =  |kg  -  k^^j 


(3-18) 

(3-19) 


The  terminal  loss  if  (i  obtains  is  0  if  the  correct  action  is  taken 
and  k^|^l-^i^l  if  the  wrong  action  is  taken.  It  is  easily  seen  that  for 

given  k^,  h,  D^Cti),  n,  and  m,  one  action  is  optimea  if  m"  <  and  the 
other  action  is  optimal  if  m"  > 

Throughout  Section  3.2  r^(n)  will  be  expressed  in  the  form  used 

in  Section  2.3  rather  than  the  form  used  in  Sections  2.1  and  2.2,  viz.. 


rt(a)  =  r  (n,  m)  D  (m)dm 
”00  ^  m 


(3-20) 


where  r^(n,  m)  denotes  the  expected  terminal  loss  of  the  optimal 
action  posterior  to  observing  m^.  For  linear  terminal  losses 

r  00 


r^(n,  m) 


/ 

./ 


k^(M  -  Jijj)  D^(n|m)d4i 
-  ^)  D^(n|m)dti 


if  m  "  <  tu 
m  -  *0 


(3-21) 
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The  following  aBSumptions  are  made  about 


00 


(i)  m'  =  / 

D  (^i)d^  <  CO 

(3-22) 

“00 

0 

(11)  Bj^) 

>  0 

(3-23) 

(111)  B^"(tL) 

2  2 

=  d  D^(n)/d4i  exists  and  is  continuous 

(3-24) 

throughout  a  neighborhood  of 

To  simplify  the  notation  slightly,  assume,  without  loss  of 
generality,  that 

k^  =  l  ,  h  =  l  ,  0-  (3-25) 

To  shorten  the  proof  of  Theorem  3*2.1,  several  lemmas  will  be  proved 
first . 

Lemma  3*2.1.  finite  and  a  strictly  Increasing  function 

of  m. 

Proof;  The  proof  which  follows  is  very  similar  to  the  proof  of 
Theorem  3.I  of  [3]  and  incorporates  an  easy  extension  of  the  ineq.uality 
on  page  43  of  [9]. 

Since 

00 

°m^“^  “  n)  d|i  >  0 

00 

and  /  ^  D  is  finite  by  assusgption  (3-22) 

■00  ° 

CO 

^  n)  (Dj^(m))  d^  <  00  . 

To  show  that  strictly  increasing,  consider  "  *^n^®l^ 

where  m^  <  m^.  Let  fjj(m^|n,  n)  be  abbreviated  to  fj^(n)  ,  i  =  1,  2. 

Then,  since 
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D3^(jilnu)  -  D^(u|m  )  ^2^^^ 

and 


iT^  “-oi  7^  > 


4n^“2^  ■  “.J  ^  ~  -L  ^  I^(m|»i)^ 

®  r^mK)  ^2^^  1 

-  Di(n|mi)  -ij  dM 


°°fry  7  ^i  D  (ulm  )  -  /  fg^  Dj^(n|in^)d<r|<4i 

-i  1  ^  Lf^  -fc  1  ^  J 


and  this  will  be  positive  If  the  Integral  Is  positive.  Now,  letting 


’^l  ■ 

.  f2(ti^)  /  f^(n^) 

and 

“ij  ■ 

DlfcJ.j) 

> 

00 

i - n 

'f‘2(^i) 

00 

fg(h) 

- 

/^‘ 

"00 

.fllST 

-  / 

“OD 

D^(^l|m^)dJl 

d4A 

00 

00 

OD 

'i  *‘1 

■  4s  ^1^11 

L  ^  '2 

^  -OD 

®21 

^2 

00 

(B 

00 

■-i  “l  ”ll 

ri  at.^ 

.L\i^2  ■ 

■  ^  ‘*1 
"00 

®n' 

d^l 

00  00 

^(ri  -  I 

:  )  D 

2'  "ll 

00 

00 

-  /  /  M. 

"00  "00 

“si 

1*^2“. 

/ 

’00 

/  1 
"oo 

7 

■00 


Ou  00 


(1)  -  (V2)_J’  ^  [(>i;j^  -  Jig)  (r^  -  Tg)]  D^  Dg^  dUg 

and  the  expression  In  brackets  Is  positive  for  #  ^g  since  f^(m|ix,  n) 
has  a  monotone  likelihood  ratio.  Hence,  since  D^Clx)  la  not  a  unitary 
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distribution,  the  expression  (l)  is  positive  and 
positive . 

To  simplify  the  proof  of  the  next  lemma,  three  preliminary  lemmas 
will  be  proved  first. 

Lemma  A.  For  fixed  £  >  0  and  M  >  0  ,  and  any  k  >  0 


/  n  D  (u)  f  (p|H/n,  n)d|i  =  o(n"^). 


Proof; 


OO  CD 

I  ^  D^(n)  :^(n|>V'n,  n)  <  ^(£  l^/n,  n)  /  u  D^(^i)dtl 

£  £ 

=  0(n^/^  e-(V2)nC^jP  ^  D^(ii)cl^)  =  o(n"^) 


00 


since  /  |i  D  (ji)d4i  <  oo  by  assvmrption  (3-22).  Simileurly 


■00 


-£ 

/  n  D  (ti)f  (nlH'n,  n)  dn  =  o(n  ). 

"00  “  "• 

Lemma  B.  For  fixed  £  >  0  and  i  >  0,  and  any  k  >  0 

I  n)4i  =  o(n“^). 

|n|>£  ^ 


For  a  =  0(n”^)  and  fixed  i  >  0,  and  any  k  >  0 


/  n(ji  -  a)^  n)  dji  *  o(n"^). 

Proof;  Letting  x  =  -  H/n)  and  £*  =  n^^®(£  -  M/n) 

T  f  n)c4A  =  /  +H/a.)^  f  ,j(x)cbc 

g  K  C  •» 

-  0(n^^  T  x^  f  ^(x)dx) 

£'  K 

=  o(n"^) 


(3-26) 


(3-27) 


(3-28) 
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The  next  lemma  has  been  proved  by  Guthrie  and  Johns  [3,  Theorem  3.3] 
for  certain  types  of  exponential  distributions  (not  including  the  Normal 
distribution)  with  mean  and  a  prior  distribution  of  ^  satisfying 
assumptions  (3-22)  -  (3-24). 

3-2.2.  (^"^(0)  =  -  (0)  /  n  D^(0)  +  o(n"^)  (3-3O) 

where  (O)  -  d  D^(n)  /  d|i  evaluated  at  =  0. 

Proof  i  It  will  be  shown  first  that  ij>“^(0)  =  0(n"^)  by  showing 

that  there  exists  an  M  >  0  and  an  N  >  0  such  that  for  n  >  N 

(1)  <^j^(-J^n)  <  0  <  4j^(H/n) 

Since  is  strictly  increasing  by  Lemma  3.2.1,  (l)  is  equivalent  to 

-M/n  <  4"^(0)  <  M/n,  or,  4-^(0)  =  0(n“^). 

Consider 

(2)  4nW“)  =  (D^(^V'n))“^^^^x  D^(p)  f^(>V'n|M,  n)du  .  ,  . 

4jj(lVn)  has  the  sign  of  the  integral  in  (2).  and,for.  any  -€.>,(3!  . 


(3) 


00 

/  n  D  (>i)f  (J^n|ji,  n)c4i 
-00  °  N  ' 


D^(n)f  (^|i^/n,  n)dM  +  o(n''^) 
N 


by  l«mma  A.  By  assumption  (3-24),  for  some  S  =  ?  (jx)  such  that  |  C  |  <  f 
£  r 

;  H  D^(n)f^(n|H/n,  n)  djx  =  /  4  (D^(0)  +  n  DJ  (f  ))f  (pj^/n,  n)dM 

*  n)dM  -  /^,^(jx|H/n,  nid^]  +  /  )f^ji|*V'n,  n)c4i 

(4) 

■  D^(0)  (H/n  +  o(n  )  +  f  n  D*  (^)fj,  (j*|*^/n,  n)d^  by  Iiemma  B.  From  assuoqption 

-e 

(3-24)  it  also  follows  that  £  can  be  chosen  such  that  |D^  (f)|  is  bounded, 
say  by  K,  on  [-£,£].  Note  that  K  is  independent  of  M.  Hence 

1/  n)d*i  I  <  K  f  f  (|i|l^n,  n)d»i 

C  If 
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(5)  =  K  [  J'  n)c4i  -  ^  j  ^  njd^i] 

»  K  [  n"'^  +  (n/d)^  +  o(n"^)  ] 

by  Lemma  B  again.  Therefore,  from  (3)  -  (5) 

D^(m)  n)d|i  >  BjO)ili/n  +  o(n"^))  -  K(n"^  .+  (l^n)^^K>(n"^)Ho(n-l) 

which  ia  positive  for  n  >  N  if  M  and  N  are  sufficiently  large  since 
D^(0)  is  positive  by  assumption  (3-23)-  A  similar  argument  shows  that 
4n(-*Vii)  negative  for  n  >  N  if  M  and  N  are  sufficiently  large. 

Hence  <|»^^(0)  =  0(n"^). 

It  will  now  be  shown  that  “*■ 

To  simplify  the  following  expressions  slightly,  temporarily  let  a  =  (^^^(O). 

It  follows  frcxa  Tj>imna  3*2.1  that  a  is  vinl^ue.  Therefore,  since  D^(a}->  0, 
a  la  the  unlq.ue  root  of 

«D 

0  h  Do(^)  n)dn 

=  /  p  D  (p)  f„(a|p,  n)dp  +  /  p  D  (p)  f„(a|p,  n)dp  . 

-e  °  ”  |p|>e  o  » 

By  assun^tlon  •('3-2U),  C  can  he  chosen  such  that  D^(p)  1®  bounded  on 

[-C,  C  ]  and  then  from  Lemma  B 

|pf>6  ^  • 

Hence 

(6)  0  =  /  p  D^(p)  fjj(a|p,  n)dp  +  o(n"^)  . 

From  the  first  pea1>  of  the  lemaa,  a  «  0(n~^)  .  Thus,  for  any  fixed  £  > 
if  n  is  large  enough,  a  [-£,  e  ],  emd  by  assumption  (3-24)  D^(p)  can  be 
expanded  about  a  so  that  (6)  can  be  written  as 
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0 


-  fn(D^(a)  +  (a)  (n-a)  +  l/2  D”  (C)(n-a)^)  fj,(aln,  n)du+o(n"^) 

“  D  (a)  (  /  u  f„(  nja,  n)d|i  -  /  n  f«(4la,  n)dM) 

0  -00  ^ 

+  D^(a)  (_j4(4-a) 

+  l/2  f  C(^‘|a,  n)(4i 

-6  ” 

«  D^(a)(aH-o(n‘'^))  +  D^(a)(n“^  +  o(n”^))  +  o(n”^) 


by  Lemmas  B  and  C.  Therefore 

(7)  0  =  aD^(a)  +  n“^  +  o(n“^). 

From  assuo^tlon  (3-24)  agedn,  ^^Ca)  and  O^Ca)  can  be  expanded  about  0  , 
for  n  sufficiently  large,  so  that  (j)  becomes 

0  =  a(D^(0)  +  a  0^(5^))  +  n"^  (d;(0)  +  a  +  o(n"^)) 

where  |  <  (aj  <  g  for  i»l,  2.  Therefore,  since  a  =  0(n"^) 

0  «  a  Dq(0)  +  n"^  D^(0)  +  o(n‘^) 
or 

a  »  4;^(0)  -  -  D^(0)  /  n  D^(0)  +  o(n’^). 

Lemma  3.2.3.  T  «  2*^^  T  /  (STr)^/^  (i+l)  (3-31) 


for  i  -  0,  1,  2, 


Proof:  Successive  integrations  by  parts  with  u  »  F^(-x)  and 

dv  ■  x^dx  (i>0,  1^  2,  ...)  and,  in  the  resulting  Integrals  of  the  form 

/  f  .  (x)dx  where  J  >  1,  with  u  «  x"^”^  and  dv  ■  x  f  (x)dx 
H*  N* 


o 

give 


2i/2  p  (i+2j  !  ^2 


i  even 


CD 


/x^P^,(-x)dx  - 


1+1 


r  (1+1)  /  2  ^  r (^)  (iti)  ,  i  odd. 
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For  1  odd  ,  m  application  of  the  duplication  formula  for  the  gamma 
function  establishes  the  lemma. 

Lemma  3«2.4.  For  fixed  £  >  0  and  i  >  0,  and  any  k  >  0,  if 
a  =  o(n”^)  then 


f  F  (aj^i,  n)d4i  =  o(n“^) 

€  H 

7  (-^)^  <3'„(a|n,  n)d4i  =  o(n"^)  . 

00  N 


(3-32) 


Proof;  Since 

and 

/  F  (|a|  In,  n)dn  >  /.  F  (a|n,  n)dn 
6  »  -  C  “ 

it  will  be  assumed  that  a  >  0  and  it  will  be  proved  that 

^  Fjj(a|n,  n)dn  =  o(n"^)  . 

Let  M  >  0  be  such  that  for  n  sufficiently  large,  a  <  M/n  . 

Then 

OD  4  OO  j 

(1)  /  n  Fj^(a|n,  n)dn  ^  I 

and  letting  x  =  n^/^(n  -  H/n)  and  g'  =  n^/^(6-  M/n) 


f  Fjj(fV'n|n,  n)cln  =  Jn’^/^Cxn"^/^  + 

=  f  x^  F  (-x)dx) 

c'  Ir 


=  o(n"^) 

since  successive  integrations  by  parts  show  that 
linear  combination  of  f^^(c')  and  F^(-g'), 


i 


X 


e' 


F  (-x)dx  is  a 

=  O(nV^)  . 
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Theorem  3.2.1.  For  the  two-action  problem  on  the  mean  ^  of  a 


Normal  process  of  hnown  precision  h  with  linear  terminal  losses  and 
an  absolutely  continuous  prior  distribution  of  satisfying  assuiiq;>tlons 
(3-22)  -  (3-2J*) 

r^(n)  =  D^(Ujj)  /  2  hn  +  0(k^n“^)  (3-33) 

where  k^  11s  the  terminal  loss  constant  defined  by  (3-1?)^ 
denotes  the  prior  density  at  the  breakeven  value  of  ji.  ,  and  n 

denotes  the  saizQple  size. 

Proof;  For  k^  =  h  =  1  and  =  0  ,  (3-26) ,  the  theorem  Is  that 
r.  (n)  =  D^(0)  /  2n  +  0(n‘^)  .  From  (3-21)  and  (3-25) 

b  O 


,(n)  »  f* r  (n,  m)  D  (m)dm 
’  -00  ^  “ 


where 


00 


If  m"  <  0 
zx  — 


^  11  Dj^(iilm)(Jii 

(-|i)  D^(iilm)dii  If  m^  >  0  . 

L-ly 


r^(n,  m) 

1 

-  oo 

Since  m^  <  0  If  and  only  If  m  <  ^”'*’(0)  by  Lemma  3*2. 1, 
be  written 

/ 

<0  o 


(1)  r  (n)  =  /  /  n  D.  (ii|m)  D  (m)diidm  +  [.  J  (-ii)D^  (li|m)D  (m)d»idm. 

^  -nn  „  1  '  m  '♦^^(O)  -®  1  '  n 


Substituting  (D^(m))"^  ^  inter¬ 

changing  the  order  of  Integration,  which  can  be  Justified  by  Fublnl's 
theorem,  gives 
00 

r+(n)  -  7  /  (1  (D  (m))"^  (ji)  f_(mlii,  n)  D  (m)dm  dii 

^  0-00  ®  OH'  m 

o  oo 


(2)  ^  /  /  (-li)(D|^(m))*^  D  (^)  f  Jm|ii,  n)dB  d|i 

-oo  j.-l/..\ 


V<°) 
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00  ■!  O  T 

=  ^  Dq(4)  n)d+i  (-m)  D^(ji)  Gjj(4’  (0)|m,  n)dti. 


The  theorem  will  be  proved  by  showing  that  r^(n)  , 
can  be  written 

r^(n)  =  2  D^(0)  ^  F^(0|n,  n)du  +  0(n"^) 


(3) 


=  D^(0)  /  2n  +  0(n‘  ) 


1/2 

since,  letting  x  -  n  '  \i  and  using  Lemma  3*2.3 

F^^(0|n,  n)clM  =  n‘^  F^.,/-x)dx  =  l/itn 

As  a  first  step  towards  establishing  (3),  from  (2) 


as  given  by  (2), 


r^(n)  =  I*  +  l'  +  ^  n  D^(n)  F^(^^^(0)  |(i>  n)(4i  (-n)D^(ji)Gjj(i^’'^(0)  |n,n)d*ji 

where 

F^,(<|i'^(0)l^,  r,)d4i 

l”  «  (.^i)  D^(^i)  Gjj(4n^(0)|M>  n)dtJi 

®  -1  ml 

Since  /  D  (>i)d*i  exists  and  ^  (O)  =  0(n  )  by  Lemma  3*2.2,  for  any 

“00  ®  ^ 


f  >  0  and  k  >  0 


T ^  D^(m)  Fj(4;;^fO)|ji,  n)dM  <  -  e ) )  J  H  D^(M)<4i 

=  0(Fj^,'.En^/^)]  =  o(n'*^) 

and  similarly 


Hence 


(U)  “  l"*"  +  l”  +  o(n"^)  . 

Nov,  by  assunQ>tlon  (3*24)  there  exists  cm  £  >0  such  that  l'*'  and 
l”  can  be  written 

«  ^»xlD^(0)+iiD^(0)+l/2  D^(5l)HFJ^(0l^l,  n)+Fjj(^^^(0)  l^l,n)-FJJ(0||i,n)](i^i 

I'  »  /(-^)[D^(0)+^lD•(0)+l/2^lV(^2)][GJ^(0|n,n)+GJJ(4;^(0)|n,n)-GJ^(0ln,n)](4^ 
where  <  6  ,  1=1,2.  Let 

(5)  I-"  =  +  4  + 13  +  ij  ^  I-  =  I-  + 1‘  + 1-  + 1; 

where 

D^(0)  Fjj(0|n,  n)d*i 
4*'  D<;(0)  VO|>i,  n)d+i 

I3  =  (1/2)  4*  (fj^)  Fj^(0|n,  n)4i 

ij  »  fg  D^(n)  C®'jj(4n^(0)  In,  n)  -  Fjj(Oln,  n)]du 

and  through  denote  the  corresponding  IntegrcQs  of  the  cmalogous 
partitioning  of  l'  . 

Since 

(6)  /  -  =  (-l)^"^^  ^4^  n)dM  ,  1  =  1,  2, 

It  follows  that 
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Thus,  from  (3)  -  (7) 


r^(n)  -  2.1*  ♦  I*  ♦  ij  ♦  I'  +  Ij  ♦  o(n"^) 

(8) 

-  D^(0)  /  2n  ♦  I*  +  ij  +  I"  +  I"  +  0(n"^)  . 

It  TTiWLlnB  to  bs  shown  that  1^  »  oCn'^)  . 

ConBldar  first  ^  assuaptlon  C  my  he  chosen  such  that 

I  0^  (C^)i  is  hoiaidad  by  N,  se^,  tbrou(^itt  the  Interval 

[-C, C  ] .  Hence 

|1*|  <1/2  H  I <  1/2  M  5^  4^  Fj,(0|4,  d)  <J4 

-1/2  7j^(-x)d* 

(9)  « 

-  1/2  Ita  (3/8)  (hy  laurt  3.2.3) 

0(n”^)  . 

By  (6)  and  (9) 

(10)  |I*|  <  1/2  »i“®(3/8)  -  0(n“^). 

Consider  next  ♦  ij^  .  By  a88un5>tlon  (3.25).  and  can  be 
written 

h  "j  (-»^HD^(0)  +  4  D^(fj^)]  (G^(<^;^0)|4,  n)  -  (^(0|4,  n)Jd4 

where 

(f^l  <  €  ^  1-  3»  Since 

Fjj(4'^(0)|4,  n)  -  Fj(0j4,  n)  -  (^(0|4,  n)  -  (^(4~^(0)||4,  n). 
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y  tiDp(0)[F^((}i"^(0)||i,  n)  -  F^(o|n,n)]d|i+^(-n)D^(0)[Gj^(4“^(0)|>i,n)-Gjj(0|ji,n)]d4 
=  I  tFN(<l'n^(0)t^^>n)  -  Fjj(Oln,n)]d>i| 

14n^(0)| 

^  4  ^  ^  n)4i  <it 


=  D^(0)  (4;^(0))2/  2 


=  0(n"^) 
by  Lemma  3-2.2 
Hence 

H  =  4  [F^ (44^(0)  I u,  n)  -  F^(0|n,  n)](4i 

=  f  °o(C4nGjj(4n^(0)|M>  n)]-  n)]4i  +  0(n"^)  . 

Letting  H  denote  a  bound  on  |'0Q(f)|  for  1^1  <  6 


.  .  e  , 

Ult  +  ^1^  1  5  2M  ^  ^  ^  n)dt  dM  +  0(n‘®) 


<2K  lo 


l't;^0)l 


*00 


00  O  _p 

/  ^  fj,(Kilt,  n)dti  dt  +  0(n  ) 


I*;'"”!  .1  3 

=  2H  (n  +  t‘^)dt  +  0(n'‘^) 


(11) 


=  2H  (n-l|4;l(0)|  (1/3)|4;^(0)P)  +  0(n-2) 

=  0(n’2) 


b>  Lemma  3-2.2. 
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Prom  (8)  -  (ll) 


r^(n)  =  D^(0)  /  2n  +  0(n"^)  . 

It  iB  not  difficult  to  show  that  for  the  general  problem 
r^(n)  =  /  2hn  +  0(k^n"^)  . 

Theorem  3-2.2.  For  r^(n)  =  k^  /  2hn  +  0(k^n  ) 

and  r  (n)  =  k  n,  the  optimal  sample  size  n  =  n  (k  )  satisfies 

8  S  O  O  w 

“o  ■  (“t 

where  k^  tends  to  infinity.  In  general^  if  r^(n)  =  ak^/n®* 

+  0(k  /  n^^)  where  a  >  0  and  r  (n)  =  k  n^,  the  optimal  sample 

V  8  8 

size  n  satisfies 
o 

n^  =  (aak^/3kg)^/^®“‘^^  +  (3-35) 

where  k^  tends  to  Infinity. 

Proof;  The  second  part  of  this  theorem  (3-35)  is  applicable  to 
the  problem  of  this  subsection  if  a  is  set  equal  to  1;  if  0  6d.8o 
equals  1,  (3-3^)  gives  a  stronger  result.  The  result  (3-35)  will  also 
be  utilized  in  the  following  subsections  and  will  be  proved  first. 

Y 

Let  n  =  fi_(k^.)  =  (<*ak+/  Pk  )  where  JT  =  (a  +  p)"^  and  let 

O  O  u  V  8 

6  =  6(k.  )  =  n  -  n.  Then 
t  o  0 

(1)  O  t  O  8  O 

=  ak^(aak^  /  31^8)"®^+  (aek^  /  pk^)^^+  0(k^^"  . 
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oy) 

The  frist  two  terms  on  the  right  side  of  (l)  are  positive  and  0(k^^ 
while  the  error  term  is  Now  suppose  n^  =  n^(k^) 

=  0(k^'  )  where  !^  +  ^  >  0  and  consider 


r(n^)  =  ak^  /  n^  +  +  0(k^  /  n^“"^) 

u  u  u 

U  w  t 


If  S  >  0,  the  second  term  on  the  right  side  of  (2)  is  positive  and 
of  larger  order  of  magnitude  than  r(n^);  if  S  <  0,  the  first  term  on 
the  right  side  of  (2 )  is  positive  and  of  larger  order  of  magnitude  than 
r(fi^).  Since  n^  is  the  optimal  sample  size,  J  =  0  and  n^  and 
n^  are  of  the  same  order  of  magnitude. 

To  show  that  £  =  o(k^  )  it  will  be  shown  that  u  = 

=»  n^  /n^  approaches  1  as  k^  tends  to  infinity.  Consider 

r(n^)  .  r(S^)  -  t  0(k|<®‘^>) 

(3)  -  (akj/n®)(Vu“  -  1)  +  („s  .  j)  ^  o(k/<»-^') 

=  kgn^^[(p/o)(l/u®-l)  +  (u^-1)]  + 

since  ak^/n^®  =  (p/o)  easily  shown  that  the  expression 

in  brackets  in  (3)  is  positive  if  u  »*  1.  Hence,  if  u  does  not 
approach  1,  then  for  any  K  >  0  ,  r(n^)  -  r(fi^)  is  positive  for  in¬ 
finitely  many  values  of  k  greater  than  K,  contradicting  the  optimality 

V 

of  n^.  Therefore  u(k^)  approaches  1  as  k^  tends  to  infinity. 
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Jf 

£  (k^)  =  ))  "til®  second  part  of  the  theorem  is  proved. 

For  the  specled  case  of  the  first  part  of  the  theorem,  a  »  p  =  1, 

“o  ■  (“t  °oK)  ^ 

r(n)  =  kn^  /  n  +  kn  +  0(k  n"^) 

8  0  6  w 

=  (kg/n)  (n  -  +  2kgn^  +  0(k^n"^)  . 

■  From  the  proof  of  the  second  part  of  the  theorem  both  n^  and  are 
and  hence 

^^•(11^)  =  k^  s  V  (n^  +  £  )  +  2k^n^  +  0(l) 
r(ao)  =  2k^fi^  +  0(1) 

and 

r(n^)  -  r(n^)  =  k^e^  /  (n^  +£)  +  0(l). 

Since  €  =  o(n„)  >  -  r(n.)  is  positive  for  k.  sufficiently  laurge 

O  O  O  w 

unless  e  =  0(n  0(k.^/*^).  QED. 

O  V 

For  the  problem  of  this  subsection,  it  follows  easily  from 

Theorems  3-2.1  and  3-2.2  that  if  r  (n)  =  k  n^ 

s  s 

""t^^o^  “  ^  ^sK^  +  (3-36) 

and,  if  n  =  0(0^) 

r(n)/r(n^)  =  (l/(l-hS))  (n/a^f  +  (^/(l-^^))  (n^n)  o(l),  (3-37) 
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l.e.,  the  generalized  optimal  loss  partition  Inequality  cmd  the  generalized 
Schlalfer's  Inequality,  both  with  a  =  1,  are  asymptotic  (k^  — ^  oo  ^ 

equalities . 

3.2.2  Symmetric  Quadratic  Terminal  Losses. 

In  this  subsection  It  Is  assumed  that  action  (a^)  Is  pre¬ 
ferred  to  action  ;  Sg  (a^)  if  ji  <  (>)  and  that  the  termineU.  loss  is 
0  if  the  correct  action  is  taken  and 

k^  (h  -  ,  k^  >  0  (3-38) 

if  the  Incorrect  action  is  taken.  Assumptions  (3-23)  and  (3-24) 
concerning  D^(h)  are  retained  and  (3-22)  is  strengthened  to 
00  o 

(!')  /  D^(fi)d»i  exists  (3-22') 

-<D  o 

Theorem  3-2.3  below  is  analogous  to  Theorem  3-2.1  and  shows  that 

for  the  problem  of  this  subsection  r^(n)  is  asymptotically  proportional 

to  The  proof  of  Theorem  3.2.3  will  be  simplified  by  first  proving 

several  lemmas.  The  first  of  these  lemmas  is  more  general  tbEm  necessary 

for  Theorem  3-2.3;  it  will  also  be  used  in  subsection  3-2.3. 

Lemma  3.2.5.  Let  L^((i)  ,  1=  1,  2,  denote  the  terminal  loss 

of  action  a^  if  ^  obtains;  and  assume  that  L^(^)  and  I^(h)  cure 

such  that  the  Integrals  below  exist  (for  symmetric  quadratic  terminal 

losses  this  follows  from  assumption  (3-22')).  If  L^(^)  is  0  for 

00 

<  0  and  non  decreasing  for  m  >  0,  then  L^(^)  D^(^|m)dtx  is  a 

non  decreasing  function  of  m.  If  l^((i)  is  non  increasing  for  ^  <  0 

o 

and  0  for  ^  >  0,  then  /  L-(^)  D^(;i|m)d4i  is  a  non  increasing  function 
of  m. 
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the  notation  and 


m 

Proof;  Consider  j  L^((x}D^ffi|m)c4i  .  Using 

OD 

the  trick  of  Lennna  3.2.1,  It  can  be  shown  that  ^  L^(n)D^(ji|iiig)d4 

OD 

-  /  Lj^(n)D^(n|in^)d*i  Is  positively  proportional  to 


(1)  (1/2)  {  ;  /  Ii(^ii)(i-i-r2)I>iiD2l‘^l<^2'^/  /  ^^*"2  ^  ^''2'"’l^°ll°21^1^2 


+  /  /  ^^1  "  ^2  ^^ll°2l‘^l‘^2  ^ 

where  =  quadrant  1.  From  the  assumptions  on  L^(n)  emd  the  monotone 
likelihood  ratio  of  f^(m|^l,n),  It  Is  easily  seen  that  (l)  Is  non  negative. 
Note  that  If  L^(p)  Is  positive  for  some  >  0,  (l)  Is  positive  and 

00 

/  I.^(n)  D^(n)|m)dn  is  strictly  decreasing  in  m  .  The  other  half  of  the 
lemma  Is  proved  In  the  same  way. 

Lemma  3.2.6.  There  exists  a  uniq.ue  such  that 

bo  2  op 

/  J  ^  <  (>)  0  for  m  <  (>)  m^jCn)  (3-39) 

and  ni^(n)  *  0(n"^)  . 

Proof;  The  existence  and  unlq.ueness  of  m^^  follow  from  the  theory 
of  monotone  likelihood  ratio  procedures  [10].  They  could  also  be  deduced 
from  Lemma  3 -2. 5-  To  complete  the  proof  of  the  lemma  it  will  be  shown 
that  there  exists  eui  M  >  0  and  an  N  >  0  such  that  for  n  >  N 
oo  P  o 

(1)  /  M  D  (ti|j^n,  n)d»i  -  /  n  D  (^|»Vn/  n)<3M  >  0 
o  -«> 

and 


00 


>eo 

o 


(2)  /  fx^D.  (M|-f^n,  n)c4i  -  /  (^j-t^n,  n)(4i  <  0. 

O  -00 

Consider  (l). 

00  o 

/  (i^D^(MlhV'n,  n)c4i  -  /  jx^D  (jxliV'n,  n)d*x 

O  -00 


(3)  =  (D^(»Vn))‘^  [  T  ^x%(^x)y^x|H/n,  n)d*x  -  J  ^2D^(,*)fp(M|lV'ii,n)dM] 


will  be  positive  If  the  quantity  in  brcu:kets  is  positive. 
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By  assumption  (3-24),  the  quantity  in  brackets  in  (3)  may  be  written  as 

n)<4i  -  f  n^D^(0)fjj(u l^/n,  n)dfi 

(4)  +  /kiV  (^^)fjj(n|t^n,  n)cl4i  -  /  (iV  (^2)fjj(>ji|H^n,  n)(4i 

+  T n)dM 

where  <  £  for  i  =  1,  2.  From  an  easy  extension  of  Lemma  A,  the 

third  line  of  (4)  is  o(n  )  for  any  k  >  0.  Letting  H  denote  a 
bound  on  |D^(pi)|  for  |fi|  <  £  ,  it  is  straightforward  to  show  that 

“S 

It  Is  also  easy  to  show  that  the  order  of  magnitude  of  the  first  line 
of  (4)  is  exactly  Mn“^/^.  Hence,  since  the  first  line  of  (4)  is  clearly 
positive,  the  entire  expression  (4)  is  positive  if  M  is  sufficiently 
large. 

Lemma  3 *2. 7*  For  f  >  0  and  a  =  0(n"^) 

I  ^^tFjj(a|^,  n)  -  Fj,(0l^,  n)]dji  +  /  >i^[Gjj(a|n,  n)  -  Gjj(0l>i,  n)]d»x=0(n‘^/^) 

(3-40) 

and 

I  4  >A^[Fj,(a|n,  n)  -  F^(0|n,  n)](4i  |  =•  0(n"^/^).  (3-41) 

Proof;  From  Lemma  3-2.4,  replacing  €  by  os  and  -  6  by 
-CO  in  (3-40)  or  (3-41)  adds  terms  of  o(n  )  where  k  is  any 
positive  number.  Hence,  for  (3-40)  it  suffices  to  show  that 

(1)  /  n®[Fjj(a|^,  n)  -  Fjj(0|n,  n)]dn  +  ^  |i^[Gj|(a||i,  n)-0j|(0||x,n)]d»i-0(n"^/^^* 
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Letting  ^  and  x  =  n^/^(a  -  ji) 

J°»i^Fj,(a|n,  n)4i  (a  -  xn"^/^)^  Fj,*(x)n"^/^dx 


and 

o  /CO 

(3)  /  M^(^(a|ii,  n)c4i  =  /  (ir-x)^GI.  *(x)dx  =  n"^/^  /  (]f'-x)^F„*(-x)dx. 

Kc  «  y  M  ^  N 

Letting  x  = 

(i*)  ^  ►i^FjjCol^,  n)dn  n^Gjj(0|n,  n)d^  =  n‘^/^  f  x^  Fj,*(-x)dx. 

From  (2)  -  (4),  the  left  side  of  (l)  may  be  written 

I  Or-x)^Fj,*(x)dx  +  f  ()r-x)^Fjj*(-x)dx-2®x^F^*(-x)dx] 

=  n"3/2[|2j-  p  *(.x)dx  +  2r“xF  *(-x)dx  +  “x^P  *(-x)dx  +  /(jr-x)^F„*(x)dx 

/  Fjj*(-x)dx  -  2//  xFj,*(-x)dx  +  /  x^Fjj*(-x)dx  -  2  /  x^Fj^(-x)dx] 

(5)  =  n‘^/^[2ir^  ^  Fjj*(-x)dx  +  (r-x)^  F^*(x)dx  -  2  /x^Fjj*(-x)dx] 

and  the  equality  (l)  will  be  true  if  the  quantity  in  brackets  in  line  (5) 
is  0(n“^). 

Since  f  =  0(n“^/^) 

rF*(.x)dx  =  0(n-^). 

r  N 

Integrating  by  parts  twice 

Y 

4*^  =  (r^/3)Fj^(-y)  -  (ir^/3)f^or)  +  (2/3)(f^(o)-f^(f)) 

=  0(n‘3/2)  .  o(n"^)  +  0(f^*(0)-fj^(y)) 


I 
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and,  letting  M  be  such  that  for  large  n , 
n[f^(0)  -  -  0[n4  - 

<  n  (1  -  =  °Z  /  j!  n-^"^  <  oo  . 

J=1 

Hence,  =  0(n”'^)-  It  remains  to  be  shown  that 


‘h* 


/  (Y-xf  F  *(x)dx  =  0(n"^) 
-i  “ 


and  this  follows  easily  since 


y  Y 

I  ^  (ir-x)^Fjj*(x)cbc  I  <  21/11  /  dx  I  =  0(f)  »  0(n‘^). 

This  establishes  (3-^0). 

To  prove  (3-^1 )>  it  suffices  to  show  that  for  a  >  0 
J  ^^tFjj(a|p,  n)  -  Fjj(0||i,  n)]dti  »  0(n"^/®) 


since 

OO  o  ^  0 

I  ^  p^tFj^(a|ji,  n)  -  Fjj(o|^#  n)]dti  |  la| J^,  n)-Fjj(0|p,  n)]c4i 

Now 

^ >A^[Fjj(a|jji,  n)  -  Fjj(0|n,  n)]<hi  •  J  ^  n)dt  d*i 

=  ^  /  f  (jxjt,  n)  dn  dt 
o  o  ^ 

»  n"^/^  /  /  (x  +  tn^/^)^  f  *(x)dx  dt 
o  r*sf  »• 

and  this  Is  ecully  seen  to  be  0(n"^^^) 

••1  ®  ^ 

since  a  -  0(n  )  and  I  *  V^*^***  "  ® 
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Theorem  3-2«3«  For  the  two-action  problem  on  the  mean  |i  of 


a  Normal  process  of  known  precision  h  with  symmetric  q,uadratlc  terminal 
losses  and  an  absolutely  continuous  prior  distribution  of  (i  satisfying 
assumptions  (3-22'),  (3-23)>  and  (3-24) 

r^(n)  =  (4  /3  )(k^D^(u^^)  /  hn^/^)  +  o(k^n'5/2)  ^2-k2) 

where  k^  is  defined  by  (3-38)  and  denotes  the  breakeven  vaiLue 
of  >1. 

Proof;  As  for  Theorem  3-2.1,  the  proof  is  given  for  the  ceise 
of  ti^=0,  k^=h=l.  Fran  Lemma  3-2-5,  it  follows  that  there  exists 
a  uniq.ue  ni^j(n)  such  that  action  a^  is  preferred  if  m  <  m^  and 
action  a^  is  preferred  if  m  >  m^.  Hence 

(1)  r^(n)  =  _^  /  D^(jilm)Dj^(m)d4i  dm  |m)Djjj(m)d|i  dm. 

Proceeding  exactly  as  in  the  proof  of  Theorem  3-2.1,  (l)  can  be  written  as 

(2)  r^(n)  =  l'*’  -►  I  -f  f’ |lS^(^l)PJJ(m^^|^i,  n)d4i  +f  H^D^(n)Gj,(mjj  |>i,n)d4i 

6  “^0 

where 

I*  =  I  ^i^Do(^)FJJ(m^J|^i,  n)d4i 

l'  =  / 

OD  2  1 

Since  ^  ^  D^(n)c4i  exists  by  assumption  (3-22')  and  m^(n)  =  ©(n""^) 

by  I«mma  3-2.6,  the  last  two  integrals  on  the  right  of  (2)  are  o(n"^) 
for  any  €  >  0  and  k  >  0  by  Lemma  3-2.4. 
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Expanding  ^q(m)  In  and  l'  and  partitioning  the  resulting 
integrals  as  In  Theorem  3*2.1  gives 

^1  =  ^  h"  I  n)d*i 

Ig  =  4%^D^(0)F^(0|h,  n)d|i  ,  I’  =J  n3D^(0)(^(0|ji,  n)dn 

=(l/2)^%^D;’(fj)Fjj(0|>i,  n)dM  ,  I"  =(1/2)  /  ^V(f2)C^(0ln,  n)dn 

^  n)  -  Fj(0|ji,  n)]d|i 

h  ^  ^  ^i^Do(^l)[(^(ln^|^,  n)  -  C^(0|^x,  n)]d*i 
How,  1^=1^  and 

2:1^  =  2  D^(0)  ^  ji^Fjj(D|ji,  n)dji  +  o(n"'^)  (by  Lemma  3*2.4) 

=  2  D^(0)n‘3/^*?t^Fjp^(-jc)dx,,+:.o(n"^) 

=  2  D^(0)n"^/^  2  r  (2)/3v^  +  o(n‘^)  (by  Lemma  3*2*3) 

=  (4/3»/2ir)  (D^(0)/n^/^)  +  o(n"^)  . 

Again  =  -I^  and  by  the  same  type  of  argument  as  was  used  to  derive 
(9)  and  (10)  in  the  proof  of  Theorem  3*2.1 

I  I3  I"  I  =  0(n'5/2)  _ 

Finally,  letting  H  denote  abound  on  1Dq(£)1  for  ||||  <  £ 
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+  /  n^[D^(0)  +  nD^(fj^)]  tG„(nib|n,  n)  -  Gj,(0|n,  n)]d|i 
<  DQ(0)t/n^[Fj,(mj^  Im,  n)  -  Fjj(o||i,  n)]  +  /  jn,  n)  -  Gjj(o|n,  n)]d4i] 

+  2  H  In,  n)  -  Fjj(o|n,  n)]dn 

=  0(n"5/^) 

by  Lemma  3.2.7.  For  the  general  problem  it  is  easily  shown  that  r^(n) 
is  as  given  by  (3-^2). 

O 

For  the  problem  of  this  subsection,  if  r  (n)  =  ^ 

s  s 

Qq  =  [(2/tt)^/^  (3-J+3) 

by  Theorem  3.2.2.  Using  Theorems  3.2.2  and  3.2.3>  it  can  be  shown  that 
the  generalized  inequalities^ with  a  =  3/2^  become  asyiiq>totic  equalities. 

3.2.3  Constant  Terminal  Losses 

In  this  subsection  it  is  assumed  that  action  a^  (a^)  is  pre¬ 
ferred  to  action  a^  (a^)  if  n  <  (>)  n^  and  that  the  terminal  loss 
Is  0  if  the  correct  action  is  tcQcen  emd  (k^  >0)  if  the  incorrect 
action  is  taken.  A  similar  problem  with  a  Normal  prior  distribution 
was  considered  in  subsection  2.4.4  and  there  k^  was  fixed  at  1.  This 
could  be  done  here  also,  but  then,  for  asymptotic  results  concerning 
n  (assuming  r(n)=kn^),  k  would  have  to  tend  to  0.  For 
consistency  with  the  rest  of  Section  3-2,  the  terminal  loss  constant 
here  is  chosen  to  be  k  ,  for  asymptotic  results  it  is  assumed  that 

V 

tends  to  infinity,  and  k^  will  be  thought  of  as  fixed.  The 


-69- 


( 


crucial  cost  parameter,  of  course,  in  all  of  the  problems  considered 

so  far  is  k  /k  .  It  is  also  assumed  that  D  (^)  satisfies  asaump- 
w  s  o 

tions  (3-23)  and  (3-24)  and  that  =  0. 

Lemma  3 >2.^  holds  for  the  problem  under  consideration  and,  as 
in  the  last  subsection,  there  exists,  for  fixed  n,  a  unlq.ue 
satisfying 

OD  o 

^  D^(^l|m)c4l  D^(u|m)(4i  <  (>)  0  for  m<  (>)  m^^Cn). 

Furthermore,  a  proof  analogous  to  that  of  Lemma  3*2.6  shows  that 
m^j(n)  =  0(n"^).  Then,  corresponding  to  Theorems  3.2.1  and  3*2.3* 
Theorem  3*2.4.  For  the  two-action  problem  on  the  mean  ^ 
of  a  Normal  process  of  known  precision  h  with  constant  terminal 
losses  (k^  for  an  incorrect  action)  and  an  absolutely  continuous 
prior  distribution  of  ^  satisfying  assumptions  (3-23)  and  (3-24) 

r^(n)  =  (2/ir)^^^  [k^  D^(Hjj)/(bn)^/^]  +  0(k^n'3/^). 

Proof;  Assuming  =  0  ,  r^(n)  can  be  written,  as  in  the 

proof  of  Theorem  3.2.1  as 

■*•.1  ^t 

00  -e 

*  I  h  to^  ^t  hn)dM. 

Using  arguments  very  similar  to  those  in  the  proof  of  Theorem  3*2.3; 

it  can  be  shown  that 

00  o/p 

r^(n)  -  2j  \  D^(0)i^(0|M,  bn)dn  0(k^n 

=  2  k^  D^(0)(hn)'^/^  J°IJpj(-x)dx  +  0(k^n"3/2). 
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The  theorem  follows  since 


®Fj,*(-x)dx  = 
For  the  problem  of  this  subsection, 


by  Lemma  3.2.2. 

if  r^(n)  =  k  n^ 
s  s 


[(1  /ZTTh)^/^  (k^  D^(4^)  /  p  k^)]V(P+l/2)  ^  q(j^^1/(P+1/2)j  (2-1^5) 


by  Theorem  3.2.2.  Using  Theorems  3.2.2  and  3.2.U,  it  can  be  shown  that  the 
generalized  inecLualities,  with  a  =  1  /  2,  become  asymptotic  eq.ualltie8. 


3.3  Finite-Action  Problems  on  the  Mean  of  a  Normal  Process  of  Known 
Precision  with  Linear  Utilities  and  an  Absolutely  Continuous 
Prior  Distribution  of  the  Process  Mean 

The  asymptotic  results  of  subsection  3.2.1  can  be  extended  to  general 
finite-action  problems  on  the  mean  of  a  Normal  process  with  linear  utilities. 
For  flin5)licity,  only  the  three-swtlon  problem  will  be  considered  explicitly. 

Le  . 

A  =  {a^,  ag,  a^  r  (3-^6) 

u^  (a^,  m)  =  +  k^p  ,  1=1,  2,  3  (3-^7) 

^ct  ^®i^  ”  terminal  loss  of  a^  if  obtains 


=  max  (u^  (a^,  4)  -  u^  (a^,  ji)),  i=l,  2,  3  (3*'^) 


=  K  -  1^)  /  -  ‘‘l) 


^tl2  I  ^2  "  ^1  I 


^^)23  =  (Kg  -  K^)  /  (k^  -  kg)  (3-1^9) 
^23  =  I  K3  -  kg  I  .  (3-50) 


The  rest  of  the  notation  used  below  is  defined  in  Section  3.2.  In 
particular,  note  that  r  (a.,  defined  in  (3-W)  is  the  conditional 

CXr  X 

(on  terminal  loss  of  action  a^  while  r^(n)  defined  in  (3-1^)  Is 
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the  expected  terminal  loss,  prior  to  observing  m,  of  an  optimal  decision 
following  a  sample  of  size  n. 

It  is  assumed  that  <  k^  and  .  These  as¬ 

sumptions  guarantee  that  the  problem  is  nondegenerate  (each  action  is 
strictly  preferred  for  some  values  of  n)  and  index  the  actions  so  that 
a^  is  preferred  if  ^  a^  is  preferred  if  H 

and  a^  is  preferred  if  |ji  >  course,  breakeven 

value  of  (x  between  a^^  and  a^,  and  breakeven  value  of  ^ 

between  a^  and  a^.  With  regard  to  the  prior  density  of  \i, 

it  is  assumed  that  (3-22)  holds  and  that  (3-23)  and  (3-24)  hold  at  both 

^S)12  ^23- 

Theorem  3.3.1.  For  the  three-action  problem  on  the  mean  ^  of  a 
Normal  process  of  known  precision  h  with  linear  utilities  emd  an 
absolutely  continuous  prior  distribution  of  ^  which  satisfies  as¬ 
sumptions  (3-22),  and  (3-23)  and  (3-24)  at  and 

=  (^12  °o^^l2^  ^23  ^oK23^^  /  Oik^n^)  (3-^1) 

where  =  max  (k^^,  k^^^). 

Proof;  From  the  assvimed  lineeurlty  of  the  termlned.  utility  functions 
u.  (a  ,  (x),  the  optimal  terminal  action  following  a  sample  of  size  n 
resulting  in  a  posterior  mean  m”  depends  only  on  whether  m"  < 

(a^  optimal),  <  m"  <  (a^  optimal),  or  m"  >  (®3  optimal). 

From  subsection  3*2.1,  Lemma  3*2.1  holds  and  Lemma  3*2.2  generalizes 
easily  to  (M^^)  /  n  ♦  oCn"^)  and 

“  **b23  "  ®o^^23^  /  "  ®o  toeorem  being 

proved,  only  the  fact  that  =  Hj,12  +  C  <%23^ 

“  ^>23  •I*  0(n  is  needed. 
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Now,  from  (3-^+7)  -  (3-50)  it  is  easily  shown  that 


'o  , 

r,t(ai,  m)  =  ^ 

^tl2^^‘‘^3l2^  ■  " 

^12  <  <  ^23 

(3-52) 

^^tl2^^"^12^  ^t23^^  ’  ^23^  ' 

•^^^23 

f^tl2^^12  ■  * 

^ct(*2'  =  { 

1 

0 

^12  <  <  ^23 

(3-53) 

1 

^^23  ^^‘^23^  ' 

J 

|^^t23^^23  ■  ^tl2Wl2  ■ 

r^t(*3,  1*)  =< 

^t23^^23  "  ' 

^12  -  -  ^323 

(3-5*^) 

.0 

►^^^23. 

r+(n)  =  /  r  (n,  m)  D  (m)dm  (3-55) 

X  ^  T)  m 

where,  for  values  of  m  such  that  a^  is  optimal 

r^(n,  “)  =  ^  ^ct^®i^  Dj^(n|m)c4i  .  (3-56) 

Action  a^,  for  example,  is  optimea  if  and  only  if  m"  < 
by  Lemma  3*2.1,  m"  <  if  and  only  if  m  < 

contribution  to  r  (n)  from  values  of  m  such  that  a.,  is  optimal  is 
t  X 

given  by 
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*^11  ^^12  ^  00 

^  ^  D,  (^|in)d*i  D  (m)dm 

no  -rv^  X  ±  ui 


^12  *^)23 


from  (3-52).  The  complete  expression  for  r^(n)  can  be  indicated  by 
00  00  ®2 

rt(n)  =//  +  //+/  / 

-QD  b-,  -oo  b„  a, -00 


(3-57) 


b, 
00  1 


b- 
oo  2 


2  00 

//  +  ;/  +  // 


"1  "^2 


&2 


a^  -CD 


Where  a^  =  \  =  ^,i,i+r 


In  each  of  the  six  double  integrals  in  (3-57 )>  the  integrand  is  determined 
by  the  index  of  bj  if  b^  appears  as  a  limit  of  integration  the 
integrand  is 


^t,i,i+l  I  ^  ■  ^,i,i+l 


D^(n|m)  Djj(m). 


(3-58) 


Combining  the  second  and  fourth  double  integreds  and  the  third  and  fifth 
double  integrals  on  the  right  side  of  (3-57)  gives 

cp  CD  '^l  ®2  00  00  ^2 

(3-59) 


®1  cp  CD  ^1  ®2  00  00  ^2 

r^(n)  =  /  f  +//  +  //  +  //  . 

^  -00  b,  a,  -00  -00  b^  a„  -oo 


Applying  Theorem  3*2.1  to  the  first  two  double  Integrals  and  again  to 
the  last  two  double  Integrals  on  the  right  side  of  (3-59)  establishes 
the  theorem. 
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Tbe  discussion  above  clecurly  generalizes  to  the  nondegenerate 
p-action  problem.  If  the  actions  are  indexed,  so  that  the  index  of  the 
optimal  action  never  decreases  as  Increases 

“t.l.Wl  “oK,!,!.!')  ! 

where  ^  ^  and  are  the  obvious  generalizations  of 

the  notation  used  in  the  three-action  problem. 

From  Theorem  3*2.2  it  follows  that  the  optimal  sainple  size  n^ 
for  the  p-action  problem  being  discussed  with  r  (n)  ■  k  n  satisfies 

B  o 

"o  ■  ^,1,1.1  “oK,!,!*!”  ' 

Asymptotic  optimal  san^le  sizes  for  the  p-actlon  problem  with  r  (n)ak  n^ 

0  8 

also  follow  from  (3-60)  and  Theorem  3*2.2. 

The  analysis  of  this  section  can  be  extended  to  other  loss  functions 
but  the  details  will  not  be  given.  Roughly,  with  mild  restrictions  on  the 
rates  of  increase  of  the  tenainal  loss  functions,  the  first  order  terms 
making  up  r^(n)  dex>end  only  on  the  terminal  loss  functions  of  "second- 
best"  actions  in  neighborhoods  of  the  breakeven  points.  If,  for  exaaqple, 
these  losses  are  all  constants,  for  large  n^  r^(n)  will  be  asymptotically 

1/2 

proportional  to  a  weighted  sum  of  these  constants  divided  by  n  '  where 
the  weights  are  the  prior  densities  at  the  breakeven  points. 

3.4  Finite-Action  Problems  on  the  Mean  of  a  Momal  Process  of  Unknown 

Precision  with  Linear  Terminal  Utilities  and  an  Absolutely  Continuous 
Joint  Prior  Distribution  of  the  Process  Mean  and  Precision 
In  this  section  the  results  of  subsection  3*2.1  and  Section  3*3 
are  generalized  to  the  case  in  which  the  process  precision  is  unknown. 

Only  the  tvo-actlon  problem  is  considered  ea^llcltly. 
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Let  h)  denote  the  Joint  prior  density  of  ((I,  h)  and 

D^(M|h}  the  prior  conditional  density  of  {I  given  h.  It  is  assumed 
that  assumptions  (3-22)  -  (3-24)  hold  for  D^(4|h)  for  all  h  >  0  and 
further,  that  a  neighborhood  of  C4jj|h)  exists  such  that  (3-24)  holds 
uniformly  in  h  and  that  the  second  negative  mament  of  the  max^Slnal  fodof 
dlstrlbatlon  of  ::  h  Is  jflnlte. 

From  the  proof- of, Theorem  3.2.1  it  is  easily  shovm  that 
/ 

r^(n[h)^=  D^(^l^lh)  /  2hn  +  0(k^(hn)"^).  (3-62) 

Hence,  if  DQ(h)  denotes  the  margined  prior  density  of  h  and  D^((i^) 
the  meirgineLL  prior  density  of  p  at 
00 

rt(n)  =  ^  D^(h)  r^(nlh)  dh 

=  (k^/2n)  J  h‘^  D^(h)D^(n^^|h)dh  +  0(k^  ^  (hn)“^D^(h)dh) 

=.  (k^/2n)  J h’^  D^(h)D^(n^j  |h)dh  +  0(k^n"^) 

=  (k^/2n)  J 

=  (k^/2n )  (njj )  (h"^  I )  +  0  (k^n"^ ) 

where 

denotes  the  prior  expectation  of  the  process  variance  conditional  on 

=  JXb- 

Thus,  for  the  a8yiiQ)totic  form  of  r  (n)  and  hence,  the  asysQitotlc 

w 

optimal  saBQ>le  size,  1^q(>^)  certainty  equivalent  for  the 

Joint  prior  density  DQ(h,  h). 
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Addenda  to 


BAYES  DECISION  THEORY: 

INSENSITIVITY  TO  NON-OPTIMAL  DESIGN 
Gordon  R.  Antelman 

1.  Pages  (i)  and  (li)  are  reversed.  ( Am  #ncl«d  •  df  f  rego  rd ) 

2.  P,  1,  par.  1.  A  general  formulation  of  a  class  of  decision  prob¬ 
lems,  which  includes  all  of  the  problems  discussed  here,  is  given 
by  Raiffa  and  Schlaifer  [1,  Chapters  1  and  4].  The  terminology, 
and  to  a  large  extent,  the  notation  used  in  this  report  follows 
that  of  [1], 

3.  P.  1,  1.  10.  Replace  "which  have  not  been  considered  elsewhere." 
by  "discussed  here  but  not  elsewhere." 

4.  P.  4,  1.  2.  Insert  "(Theorem  3.2.2)"  after  "derived". 

5.  P.  4,  1.  4.  Replace  the  sentence  "The  asymptotic  form  ...  "  by 
"The  asyii^)totic  form  of  r^(n)  is  also  considered  for  symmetric 
quadratic  terminal  losses  (Section  3*2.2)  and  for  constant  terminal 
losses,  i.e.,  the  hypothesis  testing  formulation  (Section  3.2.3)." 

6.  P.  4,  1.  4  of  Sec.  1.2.  Replace  "a  continuous"  by  "an  absolutely 
continuous ." 

7.  P.  4,  1.  5  of  Sec.  1,2.  Insert  "as  (k  /k  )  tends  to  infinity," 

C  8 

after  "it  is  shown  that." 

8.  P.  1.  11.  After  "variance."  Insert  "(The  analysis  referred  to 
treats  n  as  a  continuous  variable;  from  a  practical  standpoint, 
one  observation  would  be  required  in  the  limit.)" 

9.  P,  6,  1.  12.  Concerning  "The  reason  for  this  difference  is  dis¬ 
cussed  in  Section  2.4.^."  and  the  following  sentence,  see  also 


I- 


point  22  of  this  addenda. 

10.  P.  6,  1.  4*  (a  star  superscript  is  used  as  an  abbreviation  for 
"from  the  bottom  of  the  page").  Replace  "non  unitary  (two-point)" 
by  "two-point  (non  unitary)." 

11.  P.  7>  1.  Replace  "Indicated"  by  "indicates." 

12.  P.  8,  par.  2.  This  two-action  problem  is  stated  in  terms  of 
linear  terminal  profits ,  rather  than  utilities,  in  [2]. 

13.  P.  8,  last  par.  All  of  the  problems  discussed  in  this  report  are 
phrased  either  in  terms  of  utilities  or  in  terms  of  opportunity 
losses  and  in  every  case  it  is  assumed  either  that  total  utility 
is  the  sum  of  a  terminal  utility  and  a  sampling  utility  or  that 
total  opportunity  loss  is  the  sum  of  a  terminal  opportunity  loss 
and  a  san^ling  loss.  It  is  shown  in  [1,  p.  84]  that  if  terminal 
utilities  and  sampling  utilities  are  additive  and  the  utility  scale 
is  chosen  such  that  the  sanpllng  utility  of  a  sample  of  size  0  is  0, 
total  opportunity  losses  can  be  written  as  the  sum  of  terminal  op¬ 
portunity  losses  and  san^ling  losses,  or  costs  of  sampling,  where 
the  costs  of  sampling  equal  the  negative  of  the  utility  of  sampling. 

14.  P.  12,  eq.  (2-11).  Replace  "f^(t|n,h)"  by  "fjj(t||i,h)" 

15.  P.  13.  e<l.  (2-21).  Replace  "(hn')^"  by  "(hn')'^." 

16.  P.  13.  eq.  (2-26).  Replace  "(hn*)"^  "  by  "k^(hn*)”^." 

17.  P.  14,  eq.  (2-30)  and  the  two  sentences  following  (2-30).  As  it 

stands,  the  sentence  following  (2-30)  is  not  true.  However,  (2-3O) 
can  be  weakened  to 

(li')  d®r^(n)/dn^  exists,  n  >  0.  (2-30') 

and  Theorems  2.3.I  -  2.3.3  etill  hold,  and  it  can  be  shown  that 
regularity  properties  (i)  and  (ii*)  and  Conditions  1  and  II 


-II- 


guarantee  that  is  either  0  or  unique  and  positive. 

18,  P.  l8,  eq  (2-44).  Replace  "b"  by  "k  ." 

s 

19.  P.  20,  Theorem  2.3.3.  Following  is  a  restatement  of  Theorem  2.3.2 
and  an  expanded  and  corrected  proof. 

Theorem  2.3.3*  If  Condition  II  is  true  for  0!  =  a  >0  and 

r^(n)  =  o(n"^),  then  Condition  I  is  true  for  a  = 

Proof:  Since  r^(n)  is  an  expected  terminal  opportunity  loss 

and  terminal  opportunity  losses  are  necessarily  non  negative,  r^(n) 

is  non  negative  for  all  n  >  0.  By  regularity  property  (i)  (2-29), 
r^(n)  is  strictly  decreasing  for  n  >  0,  Therefore  Ci(^r^(n)  decreases 

to  a  non  negative  constant,  say  c,  as  n  -*‘o.  Since  nr^(n)  -♦  0  as 

n  -♦«  by  hypothesis, 

nr ' (n)  +  a  r^(n)  -»  c 
t'  '  o  t'  ' 


as  n  -*00. 


Now 

-a  a  +1 

d(nr^(n)  +  a^r^(n))/dn  =  n  °  d(n  °  r^(n))/dn 

and  this  is  negative  for  all  n  >  0  by  Condition  II  (2-36).  Ther:;- 
fore,  nr^(n)  +  a^r^(n)  is  positive  for  all  n  >  0  since  it  has  .i 

negative  derivative  and  approaches  a  non  negative  constant  as  n  -»». 
Since 


1-a  a 

nr'(n)  +  a  r  (n)  =  n  °  d(n  °  r  (n))/dn 
tot  t 

a 

it  follows  that  d(n  °  r^(n))/dn  >  0  for  all  n  >  0,  which  is 

Condition  I  (2-3I)  for  a  =  a  . 

o 


20.  P.  20,  1.  1  of  footnote  e.  Replace  "n  <  0"  by  "n  >  0." 
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21.  P.  22,  1.  2  of  proof  of  Lemna  2.4.2.  Replace  ’'r^(n)"  by  "r’^(n)." 

22.  P.  35*  Sec.  2.4.5.  To  illustrate  the  similarity  of  the  results 

of  this  subsection  and  Che  results  for  two-action  problems  with 

discrete  prior  distributions,  consider  a  two-action  problem  on  Che 

mean  4  of  a  Normal  process  of  known  precision  h  with  linear  terminal 

losses,  san^ling  costs  =  k  n,  and  a  discrete  prior  distribution  of 

s 

JI.  For  simplicity,  assume  Chat  the  mean  of  Che  prior  distribution 

is  0,  that  4,  =  0,  and  that  h  and  k^,  defined  by  (2-17)  are  both  1. 

0  t 

Let  Dq(4£)  denote  the  prior  probability  that  4=4^  and  let  Dj^(4j^|m) 

denote  the  posterior  probability  that  4=4^  given  an  observed 

san^le  mean  m. 

From  (2-86)  -  (2-88) 

00 

■  (1)  r  (n)  =  /  r  (n,m)  D  (m)dm 

c  cm 

-00 

and  in  analogy  v^ith  (2-91)  and  the  sentence  following  (2-91) 

L  4^  Dj^(4^)m)  if  m  <  0 

4.  >  0 

(2)  r.(n,m)  = 

Z  (-4^)  D^(^iJm)  ifm>0. 

4j^  <  0 

Substituting  (2)  in  (l)  and  replacing  Dj^(4j^|m)  by 

^©(^i)  fjj(«n||ij^.n)/D^(m)  yields 

0  00 
r^(n)  =  £  ^^i°o^^i^'^  fjj(ml4^  ,n)dm  +  £  (-4j^)Dj^(4j^)(/;C(m)|i. 

4^  >  0  -«  <  0  0 

4j^  >  0  4j^  <  0 

from  which  it  can  be  seen  Chat  r^(n)  decreases  exponentially  fast 


,n)dm 
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as  n  Increases.  As  a  result  o£  this,  it  can  be  shown  Chat  if 


I 
f 

k  -»0,  so  that  n  -♦<»,  r^(n  )/r  (n  )  -^O.  This  cons lus ion  can 
s  o  t'  o'  s'  o 

I  easily  be  generalized  to  constant  or  quadratic  terminal  losses 

and  can  also  be  generalized  to  Che  case  in  which  Che  mean  of  Che 
^  prior  distribution  ^ 

^  In  summary,  for  these  two-action  problems,  discrete  prior 

distributions  or  continuous  prior  distributions  and  an  indifference 
region  about  u,  result  in  r^(n  )/r  (n  )  -*0  as  n  -♦oo  while  for 

continuous  prior  distributions  and  no  indefference  region  about 

rj.(n^)/r^ (n^)  approaches  a  positive  constant  as  n^  ^oo.  The  former 

result  rests  on  Che  "tail  behaviour"  of  Che  Normal  distribution 
(see,  e.g.,  (3)  above  or  (2-116)),  the  latter  result  depends  on 
Che  "central  behaviour"  of  the  Normal  distribution  (see,  e.g.,  (2-109))* 
23.  P.  43,  1.  3*  Replace  "Lebesque"  by  "Lebesgue." 

2k.  P.  46,  1.  1.  Replace  "The  following  ...  "  by  "For  given  the 
following  ...  ". 

25.  P.  51i  1.  k.  Replace  "o(n-l)"  by  "o(n'^)." 

26.  P.  51,  1.  2*.  Insert  "e"  between  "a"  and  "[-tfl." 

27.  P.  52,  1.  3*.  Replace  "(2  )^  "  by  "(2jr)^  ." 

28.  P.  54,  1.  1*.  Insert  "D^(m)"  before  "dmd|i." 

29.  P.  60,  1.  1.  Replace  "frist"  by  "first." 

I  30*  ^*  64.  Underline  "Lemma  3*2.7*" 

I  31*  P*  71»  title  of  Sec.  3.3.  Insert  "Terminal"  after  "Linear." 

32.  P.  76,  1*  4.  Replace  "(p^|h)"  by 
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